THE ANNALS 
of 



(fo0n»»d »t h. c. carveh) 

The Ofeiciai/ Journal of the Institute of 
Mathematical Statistics 


VOLUME XV 


1944 





THE ANNALS 

OF MATHEMATICAL STATISTICS 


EDITBU liy 
S. S. WILKS, Kdilor 

A. T. cuAiG n. mvrivU.lNr: 

W, E. DKMING J. XKY.MAN 

T. C. EliY W. A. SIIICWIIAUT 


W, G. CooHnAN 

J. H. COIITIBB 
n. F. Dodoe 
P. S, Dwyer 


WITH THE COOl'BUATION ()F 

C. Kiskniuht 
VV, K. FKi.i.En 
r. «. ItOKi. 

W. C 5 . Maiiow 


A. M. M{>»» 
II. KcJtRPrt 
A. WAl,t> 

J, Woi-FowiTa 


The Annals op Matiikmatical Statistk-s in juifilisheU quarU'rly by Ihe 
Institute of Mathematical Statistics, Mt. Royal & Guilford Avc'.s., Rulfimore 2, 
Md. Subscriptions, renewals, orders for back tumibem uufl otlier l)HKiiie.s.s com¬ 
munications should be sent to the Annals OF Matulkmatk ai, f^rATiSTiOfi, Mt. 
Royal & Guilford Aves., Baltimore 2, Md., or to the Secretary of the Insti¬ 
tute of Mathematical Statistics, R. S. Dwyer, lid I{a''kh:iut Hail, (‘niver.sity of 
Michigan, Ann Arbor, Mich. 

Changes in mailing address which are, to become cITcetive ler a M;ivt*n 
issue should bo reported to the, Seerotary on or laiforc the l.dtb of tho 
month preceding the montli of tliat issue 'I'hc montlrs of issue are March, 
June, September and December. Because of war-time diilienlties uf luihlica- 
tion, issues may often be from two U> four weeks late in appi'oring. 
Subscribers are Iherpforc requeskd to wail at least ,i0 liui/s tifOr mnuth of wsafl 
before making inquiries concerning non-delivery. 

Manuscripts for puliliwitioo in the Annals of Mathematical .STATtsTica 
should'be sent to S. S. Wilks, Fine Hall, Princeton, Ne.w Jersey. Mami^erlpts 
should be typewritten doublo-spuccd with wide margiiw, and the original copy 
should be submitted Footnotes should bo reduced to a miiummu unci wlionover 
possible replaced by a bibliography at tlie, end of the itaper; formnliie in foot¬ 
notes should be avoided, Figures, charts, and diagrams .should be* drawn on 
plain white paper or tracing cloth in black India ink twice the size they arc to 
be printed. Authors are requested to keep in mind typographical difficulties 
of complicated mathematical formulae. 

Authors will ordinarily receive only galley proofs. Fifty reprints without 
covers will be furnished free. Additional reprints and covers lurnialicd at cost. 

The subscription price for the Annals is $5.00 per year. Single copies $1.50. 
Back numbers arc .available at $5.00 per volume, or $1,50 per single, issue. 


Composed and at the 

WAVERLY PRK.SS. Inc. 
BALTiMonn, Md., U. S. A. 


CONTENTS OF VOLUME XV 

Ajmrtii-.s 

ANDKHhON, T W. AND dlUMUCK, M. A v^OmC K\f(‘IlMdtl,*- rif (h(‘ Wii-hiU'l 

Distribution. ... . iD.’‘i 

BANCitorr, T. A On Hiasfs in Rsfinnitinn Due t(» thn Uw of I'jt'liniinary 
Tests of SignificusK'c ... .. IW) 

CmmcHMAN, ('. West and Ri's’mN, Hknjamia, ()n th(‘ Stuf i'-fies of ricnM " 

t.mty Data. . . W* 

Dixon, Widkiud J. Further (ionlributionH to the I’rolilern of Serial Cor¬ 
relation . . Hh 

Doob, J. L. The Elementary (laussian IVocesKeA. .. 221* 

DwiBR, Paul B. A Matrix Presentation of Least Hcjuans ami Correlalion 
Theory with Matrix Justification of Im|iroved lilelliotls of Snlutiun h'i 
Epstkin, Bknjamin and CHTinniMAN’ C. Wkst. On the Sl!it;.sli(;s of 

Sensitivity Data ... ... . fK) 

Geihingeu, IIidda, On the, Probaliility 'fheory of Linkage in Mfuidelian 

Heredity. . .. 'S} 

GmsmcK, M. A. and Andkusdn, T. \V, Some Extensions of the Wisliuil 
Distribution ...... HI ft 

Giuuuis, P'liANK I'l, On the Distribulion of the Hndial Stamiard Devia¬ 
tion. 7ti 

Gumbed, E. j. Ranges and Midranges.. . •11! 

Halmos, Paxji. R. Random Alms. Ih'J 

IlAnsniiARGKB, Boyd, On the Anuly.si.s of a Certnin Si,\-by-Si.x Foiir-f Iroiqi 

Lattioe Design . . ;jt)7 

HoteIiLing, IIvuodd, Some Imiirovernents in Weighing and other F,x]teri 
mental Teehniiiues. , 21*7 

Hsu, L. C. Some Combinatorial Formula.s with Ajipliealions to Probable 
t'alues of a Polynumial-Produet and to Differenees of JSero , Hyp 

Hurwitz, H. and Kao, M, LStatislical Analysis of Certain 'I'yiie.s of Ran¬ 
dom Functions . . , 17H 

Kac', M. and Hmnvn'z, If. Statislieal Analysis of Certain 'lypcs of Ran¬ 
dom Functions , . . . I7H 

Leumek, Emma. Inverse Tables of IVobabilities of Errors of the Semiid 

Kind,, ., . ... . ,yKK 

Levene, H. and Woi.i owitz, j, The, Covariamui Matrix of JiunH Dp ami 

Down. .... 

Madow, LiimiAN and Mmiom-. Wibbiam G. On the 'I'lienry tj Syslemutie 

Sampling, I. . , i 

Madow, Wibbiam G. and Madow, Libi.ian. On the. Theory of Systematie 

Samjiling, I.. . . . , ^ j 

Robbins, IL E, On the Measure of a Random Set . . . Tfi 


III 





IV 


(joNTiiNTK OK vau;.MK, XV 


Sa.' 1 'Tertfiwaitk, F. K. Error ('onlrol in Matrix C!iili'ulation ,S73 

Ullman, JosEi’ir. Tlic! Probability of (^onvarKciica of an Itorativo Pro(M-Ns 
of InverlinK a Malrix . 2()5 

Wald, Ahuaham. On a Statistical Problem AriMiip; in tlie (’l!i'«M(if‘afinii of 

an Individual into One of Two Orou|).-< , M5 

Wald, Auhailvm On (JuimilaUvo Suins of Uimdom ^'a^lllblr■s 2S,3 

Wald, A. and Wolbowm/, J, Statistical Tests I-iascd on I’ennutalions of 
the Observaliunfj . TlS 

WoLKOWm, J AND Li'.VEN't;, fl. The (’ovariance Matrix of Uiuia I'li ainl 
Down , hS 

WoLFOwm, J A-syniptotic Distributions of Runs I'p uiu! Down 163 

WoLFowm, ,1. AND Wald, A. Statistical 'I’csls Bawsl on Pennufation.s of 
the Observations.... . . 368 

Notes 

BniNiiAUM, .1. W AND ZnoKKiiMAN, IIkhukut S. An Ine.qiudity Due to II. 

I-Iornich... . . , , 328 

Bowkek, Aliieut H. Note on ('(insistency of a Propo.'-ed Test, for the 
Problem of Two SamfilcAS . . OH 

Court, Lewis M. A IlnciprocH.y Principle for the XeymainPcarhim 
Theory of Te.stin|i; Statistical Hypo theses , 326 

Guevillb, T. N, E. A Cioueralizatiim of WariiiK’s Formula 21H 

Greville, T. N, E. On Multiple. Maleliing with One Variable Deck . .. 4.32 
Hotelling, IIauold. Note on a Matric Theorem of A. T. th-aiK .,. 427 

Kimball, Bradford F. Note cm A-symiilotic. Value of I’rolmliility Di.s- 
tributiou of Sum of Random Variahk's wliicli are Greater thim a. Set of 
Arbitrarily Chosen NumberH. ... . . . , 423 

Landau, H, G. Note on the. Variance and Best Estimates . 219 

Lonseth, A. T, On Relative Erroivs in Sy.stem.s of Linear Etjuatious . 323 

Robbins, Herheut On Distrilmtion-free Tolerance fumits in Ilandom 

Sampling. .... 214 

Robbins, H. E On the Expected Values of Two Statistie.s.32l 

ScHBEFE, H AND TuKBY, J. W. A Formula for Sample. Sizes for Popular 
tion Tolerance Limits .... .. . , 217 

ScHBFFE, Henry, A Note on the Bclirens-Fislier Problem ... .. 430 

Tukev, j, W. and Scheffe, H, A Formula for Sample Sizes for Popiila' 

tion Tolerance Limits., ... ... . .217 

Wald, Abraham. Note on a Le,mma .330 

Wilkins, J. Ernes'i', Jr A Note on Ske-wness and Kurtosi.s ... , 333 

WoLFowm, J, Note on Runs of Coiweciitive Elements . , f)7 

ZuciKBRMAN, Herbert S and Birnuaum, J. W. An Inequality due to II. 
Hoinioli . , . , . . 328 



CONTEKTS OF VOI.r.ME XV 


V 


Ml.sCEUI.AXKOf.N 

Abf3triu'.tH of Papers. ... . . 

Amendment.s to Ihc (Viii.stilutioii and By-Lurva of the rn.‘'fifuf<' . .'f tl) 

Annual lleport ol Ihn Pre.sidenl of tlic rn.sfitiitc 111 

Annual Rei)orfc of the .St'crf’taiy-Troa.Mircr of the In.shfuf.t' ! VA 

GoiiKtitution and By-Laws of the Instilulc 111 

Directory of the Institute , , '111 

Henry Lewis Rietz---In Mc'tnoriani. By A. U. (hathorne 1(12 

Ne\v,s and Notices .. ,,.100, 222, li.'lO, >120 

Report on the Wa,shinf!;(on MeeliiiK of tliu Institute ... ... 220 

Report on the Wollc.sley Meeting of the InstituK' , . .'WH 

Review of “Student’s" Collected Paper-s W. (L ('oehran. , .. 420 






ON THE IHEORY OF SYSTEMATIC SAMPLING, I 
By WiIjLUM (}. Madow and Liduan H. Madow''® 

1. Introduction. It is no longor nccof««ary to flomonKtratA' a nmi for tho 
theory of deHigning Kamplea. Many of the policy and oix'rating deeiKionK of 
both govemment and private induatry arc baaed on wamplca. There haa Iwn 
an inereaning tendency in government and indviKtry to make ub<‘ of sampling 
theory.® 

l^nforfanately there are atill conHiderablc differenct'a l>etween the tln'orv and 
practice of sampling. The orifpna of these differences an*, on the one hand, the ig“ 
norance of administrators concerning the practical contnhutions that samp¬ 
ling theory can make, and on the other, the lack of sampling theory permitting 
the evaluation of some useful sampling designs. 

Much has been and is being done towanls bringing theory and practice into 
agreement.* Administrators and samplers are each Kuccewfully educating iht* 
others. However, there still exist sampling designs for which an adeepiate 
theory has not been developed, even thtmgh expi'rienre indiraU'w that if such a 
theory were developed it would demonstrate the superiority of tlows* designs 
over others for which a theory has l)een develojKHl. 

Perhaps the. major omission of sampling theory frKiay is the hu‘k of any statisti¬ 
cal meth(xi for rt'aching a tiecision on wlu'ther to take a completelj' random 
sample of n elements of a population of N elements, or to take a systematic 
sample, that is, to begin with element i, and select elements i', t -1- A*, • • • , f +• 
(n — 1)A, as the sample, the starting point i Wing ehtwen at random and A' « 
kn approximately.® It is with ros{)ect to this (juestion of whether to take a 
systematic* or random sample that the statistician is in a dilemma Wcause lie 
has the alternative of recommending a systematic sampling procedure for which 
no theory exists, or a random sampling procerlure that may well yield worse 

> Bureau of Agricultural Economics and F(K)d Distribution .WministFation, U. H. De¬ 
partment of Agriculture, Waaliington, D. C. 

' Presented at a meeting of the ecmiuar in slulistira of the (irudunU' EcIkkiI, S. De¬ 
partment of Agriculture, November 2, 15M3. 

> The recognition of the need for statietieiana who know aompling theory Ima r*‘i«ulKHl 
in coursea in aampling being given in some of the collegi'fl and uraveraiUwi. 

< One need only refer to the recent development of jMsdiions, the dmiea of which include 
giving advice on aampling teehniquea aa well aa working in the field of applicttUon. 

* In this paper wo will aaaumo that N <" kn. To do away with tiint wwutnpUoa would 
not add much in tho way of generality while it would require some fairly detailed diaeiwainn. 
It may be remarked that when N ia not exactly fcn, then ayatemalic santpllnx procedure# in 
which all starling points have equal probability of selection are biased, although the bias 
is usually trivial. If N is known this bias can be removed by aampling proportionate to 
possible size of systematic sample, 

‘ As we define eystematio sampling procedures, a systematic sampUag procwiur© is a 
random sampling procedure in which many of the C? selections of n from N items are ex¬ 
cluded. 
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results than the systematic procedure. The putpuH' ftf thi?. iiaper i.-, fo re«rtlve 
that conflict by providing an adequate tlietmy of .vy.steniatie sampling. 

In the folloumg .scctionH we pre.semt the first parts of our research in the tlieory 
of .systematic .samples. Although this research covers both the theory of samp¬ 
ling single elements and .sampling clusters of elements, ue shall consider, in this 
paper, the sampling units to he single elements, not elustens of elements. The 
latter problem will be dealt with in a later paj:>er. We sliali pre.seiit the theory 
of systematic sampling both from an unatratified population and a stratifu*d 
population. Formulas for the mean value and varianee.s of the e.stinmt<’« are. 
derived Comparison.s with random and stratified random sampling designs 
are made. Furthermore, the estimates of tlie variances and formulas for "opti¬ 
mum” size and allocation of sample.', are derived. 

A fundamental part of the anaiy.si8 is the demonstration that from a knowl¬ 
edge of the variance of the population^ and certain .stmial correlations or serial 
variances, can be estimated the variance of estimate.^ ha.stKi on systematic 
samples. The basic results are: 

a. if the serial correlations have a positive sum, systematic, sampling is worse 
than random sampling, 

b. if the serial correlations have a sum that is appro.\.imately zero, systematic 
sampling is approximately equivalent to random sampling, and 

c. if the aerial correlations have a negative sum, Bystcmatic sampling is better 
than random sampling. 

2. The use of a finite population. In this paper we assume., for the calcula¬ 
tion of the expected values, that we are sampling from a finite population of ele¬ 
ments even though the size of the population may Iks large enough to pennit the 
use of limiting distributions. Often, this is, mathematically, a matter of choice. 
The same results would be obtained by assuming a correctly defined multivariate 
normal distribution and using the notions of conditional probability. Prom a 
physical point of view, however, there are several factors that lead to the use of 
the fimte population. We are most frequently sampling an existing population 
whose laws of transformation are either unknown or not mathematically ex¬ 
pressed.® Consequently, the notion of a normal or other specified distribution 
from which we sample and use conditional probability is not part of our thinking 
concerning the physical problem. On the other hand, if we consider the popula¬ 
tion to be a finite population, and use a table of random numbers to draw our 
sample from the finite population, we are using only mathematics implicit in 
our physical problem. Furthermore, we do obtain a repeatable experiment, 
that of selecting a random number, that we know is in a state of Statistical 
control. 

In the usual problems of the theory of random sampling, the number of 

1 By “vanance of population” without further qualihoation is meant the variance of a 
random sample of one element of the population. 

• In other words, our population is not in a state of statistical control over time. 
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possible samples yioldinp; different sample means is large enoiigli so fliaf tlu' 
sample means may, with a sufficiently large size of population and sample, be 
expected to be approximately normally di.strihuted. In systematic sampling, 
however, the number of po.sHiblc sample means is usually very small and even if 
the sizes of population and sample are large, it is difficult to {issumc a normal 
distribution. C’onseriuently, in our interpretation of (he means and variances 
of systematic samples we are led to regard the elements of our popnlation.s it> 
being the results of single observations on random variables, the distributions 
of which may vary from element to element. The interpretations that we then 
make become interpretations of conditional probability, and if the sizf>s of 
population and sample are sufficiently large, we can lussume that the arithmetic 
mean of each of the possible sample means is normally (lislnlmtetl. 

The theory of systematic sampling under the assumption of an appropriate 
normal multivariate distribution will be dealt with at a later time. 

3. Definitions. Let the finite population to he sampled ccmsi.st of ,\’ elements, 

Xi , ■ • • , X/f ■ 

By a sample design is meant the combination of a method of classifying thcM" 
N elements into k clas.scs that may or may not overlap, and a nietluHl of wdert- 
ing one of the.se k classes, each class having a designateil jimlailulitv of being 
selected. The sampling procedure, associated wifli a given sample de.«ign is tin* 
operation of selecting one of the k classes accowling to the metluMl sfatiHl in the 
sample design. The sample is the particular class nblainetl by the '«!unphng 
procedure. 

By a random sampling procedure is meant any sampling iircK’cdure such tlmt 
if the sampling design yields k classes then the probability of selecting anyone 
of these classes is 1/k. Any sample design liaving a random .sampling proc(>dure 
associated with it is a random sampling design, dne of the nonmndom sarnfi- 
ling procedures that is being used is the procedure in uhich the cl8ft.se.s have 
associated to them numbers, called sizes, and the probability of a given class 
being the sample is proportionate to its size.® Other nonrandom sampling pro¬ 
cedures are doubtless being u^d. 

By an unrestricted random sampling design for .selecting n elements from .V 
elements is meant the sampling design such that there an* O', elasK(*s, the prwtible 
selections of ?i from N elements, each having a probability of 1, of being the 
sample. The associated random sampling procedure might consist in identify^ 
ing each class by a number i, i = 1, ■■■ , and selecting a mimlier i from a 
table of random numbers. The random aampHng procedure might hIbo e<irwi«t 
in identifying the N elements with numbers; 1, ■ ■ • , jV, anti tlien wdtH’ting 
a number j from a table of random numbers, then selecting a different inunheri 
from a table of random numbers, and following that procedure until n numf«*rH 


' For a discuesion of this problem see the paper entitled, "On the theory of Mmpliog 
from finite populations,” by Morris H. Hansen and William N. HurwiI*. Aiwafs of MaJA. 
Slat., Vol. 14 (1943), pp. 333-362. 
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from 1, • • • , A’' without rei^titinn liiivt' .^olfctcrl from fh<> table of ramlom 
numbers. The elements a-xstveiaUKl witli thew inU'gens; vvcnild he a random 
sample. It is easy to see that the ivo pritcedure.** are Hpiivalent. 

A random sampling design that is not unrestrieted in nidd to be restrieletl. 
There are many type.s of n'.strietwl random ftarnpling designs of whieh v,'hat we 
call systematic designs arc only one. Among thc',<t(> r(*strirtrHl designs are 
stratified, cluster, double, matched, polynomial, and other wuuplitig designs, 
each having been developed a.s attempts to bring theor>* and pnmtiee together, 
to suggest improvements in practice, and to solve problems arising in praetire. 

By a systematic sampling design is meant a elawification of the N elements 
into k classes, Si, ■ • ■ , Hi where iS', conaiats of x,, j', 4 *, • • • , . and a 

random sampling procedure for selecting one of the A', . 

It is thus clear that a sy.stematip sampling design is a lyix* of cluster mvmpling 
design. It will be shown that the new aspect of cluster .sampling intrcKlucerl in 
systematic sampling i.s that a knowledge of the order of tlie elements in the 
population is used to obtain the values of the intraclass correlation coefFicient 
and changes in the value of that coeffioient as the size of sample changes. 

Sampling designs may involve combinations of random and systematic samp¬ 
ling designs, as well as random and nonrandom sampling procedures, 

The population from which the.se samples are drawn may or may not U* .strati¬ 
fied and the sampling unite may be single elemente or cluHtei-H of elements. 

4. Bases for selecting among sample designs. From the many sampling de¬ 
signs that can be constructed in order to obtain desired estimates, one will be 
chosen for use on the bases of administrative considerationa, eoat, and .saiuiiling 
error. It has become customary, on the basis of limiting distribution theory 
and the theory of best linear unbiased e8timate.s to use the standartl deviation 
of the sample estimate about the character estimated as the measure of sampling 
error. 

Although in this paper we shall continue this practice, it mu.st he pointed out 
that as more sampling designs are constructed, there is the danger that for some 
of these designs the limiting distribution theory is not ^'alid, and the use of the 
standard error becomes more a matter of custom than the result of analysis. 
This danger is present for systematic sampling designs and is iHttng further in¬ 
vestigated. 

It is perhaps desirable to remark that bias, consistency, and efficiency are 
properties of the sampling design and estimation functions useti, not of the 
particular sample obtained, Any estimate based on a sainpl© will probably 
differ from the character estimated. It is the function of statistical analysis to 
indicate how large this difference may be. 

6. Notation. The letter, P, ivith appropriate subscripts is used for popula¬ 
tion, and Bubpopulations such as strata. 
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The number of strata is denoted by L, and the mimher of elenu'ittH in the t”' 
stratum is denoted by . Sizes of sample are denoteil by n with appropriate 
subscripts. 

The arithmetic mean of the elements of a population or subpopulation is de¬ 
noted by X with appropriate .suliseripts. 

Any particular subclass of a population as defined liv t!w‘ sampling design is 
denoted by S with subscripts. Estimates based on an iS' with subseripls are 
denoted by .r with sub-scripts. 

6. Unstratified systematic sampling, the sampling unit consisting of one ele¬ 
ment. The values assumed liy the suliscripts used in this .section are given in 
Appendix A 

Let the population, P, consist of N elements , ■ • • , xx. It is ilesired to 
estimate the arithmetic mean, x, of P. 

Let‘ N = kn, and let the class <S, consist of the n elements x,, j, • 
a:i+( 7 .-i)jt. Then; the systematic .sampling design for e.stinialing.? from a .sample 
of size n, consists of the k elasse.s, .b'l, • • , *S't, and the requirement that the 
sampling procedure be such that the probability i.s l/A', that H, i.s the elaa« 
lected by the sampling procedure. 

Let X, be the arithmetic mean of the elements of S ,, i.e., nX, » x, p Xi 4 t + 

• • + Xi+(„-i)n, and let x be the sample mean, i.e., x =» x, if A, is seleetisl by 
the sampling procedure. 

In dealing with systematic .sampling, we vShall har’e occasion to use both the 
circular and non-circular definition.s of the aerial correlation eoefficienta and the 
associated serial variances. 

We shall assume that if > kn then x* = xa_ji„ . Tlii.s is uw‘d in the circular 
definitions. 

Let W = S(x, ~ X)“, 

and let knCjtf, = — x)(x 4 +*^ — x). 

f 

Then, the circular definition of the serial correlation coefficient is =a 
Ck ^, which we shall use unless n is even, when we define pk^n by the equation 

2(r Pknjt ^ Gln/% , 

in order to .simplify the writing of the formula for <ri . 

Similarly, if we define the serial variance, , by the etjuation 

(x, - X 4 +J,„), then we are, using the circular definition of the serial variance. 
The circular definition of the serial variance ratio Vkn is then <r\^, « su which 
we shall use unless n is even, when we define Vk/,n by the equation 

2<r Vknfi ~ Skn/1 • 
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The non-circular definitions of the wrial correlations and serial varianeaj are 
given by 


(1) 

A-(n - 

- S)(\t 

i 

1 

■>? 

1 



1 > 
tr Pki 

= Ciki, 



k{n ■ 

- 6)sti 

■=> 2D(a:j 


and 



3 

f 




a\kt 

« Skt . 



The intraclass correlation coefficient p* is defined by the equation 
a^h == — i){x, — S), 

where the random process consists in first sampling one of the S, at random and 
then selecting two of the a:’s at random from the «S', that was selected, nien, 
since 

kal = — i)*, 

i 

and, 

(2) ff’p* = (n/n — l)crj — (1/n — 1 ) 0 -’ 
we have 

(3) O’! »«= ^ (1 -1- (n — l)is») 

71 

It is easy to see from (1) that the intraclasa correlation coefficient is given by 

p, “ E (n ~ Shi, 



and that consequently, if n is odd, fit is the arithmetic mean of the pt^ while if 
n is cA'en, fit is equal to the arithmetic mean of the pi„ nmiltipHed by n/(n — 1), 
Theoeem Usinff the syalematic sampling design, the cslimalc i is an un¬ 
biased estimate of and has variance <r* where 

<rl~ <r’ |l — i S (n — 5)aw| 

“ + 2 2D Pip) 

fi 

= (1 -b (n - 1)?*). 

“ A proof of Theorem 1 that ia somewhat simpler to follow but which, in the authors 
opinion, IS not as informative as that given below could be obtained by subatituting for 
Pausing equations (2) and (3). The lemmas in Appendix B are, of course, of interest in 
themselves in finite sampling. 
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Proof: From the definitions of expected value, J',, x, and the h-y«t«‘iiuitic suinp- 
ling design, it follows that x is a variate with possible value-' Xi , • ■ ■ , , the 

probability that x = Xi being 1/A:. Then 

(5) kSsi = 4- • • ■ -4 Xfc, 

and, when the values of the £,• are substituted in (fi), it follows that t'l — .i. 
that is, i is an unbiased estimate of £. 

Having calculated iSx, it is necessary to calculate in order to evaluate 
al . From the definition of expected values, it follows that 

(6) kSz" = s\+ + il, 

and when the values of the are substituted in (6), it follows tliat 

( 7 ) Ti Ic<s*x ^ 

»,a,Tf 

Then, •when/(u) is replaced by u in Lemma 6 of Appendix K, it follows, from 
the definition of the variance, that <rl ~ ^ (x, - x)’ — ^ ~ 

xjxuY = a-'‘ — \ — 5)aitj, and when f(u) is Replaced liy u in lAunmn H, it 

W I 

follows that 

(jfcb) ? (ii») I? "■ 

If in Lemma 9 of Appendix B we now replace f{xj, xj+u) by (Xj — Xjt-nf 



and if we replace/(x/, x,+m) by (x/ — — f) tlien 

<r* = ^ (o-* + 2^3 Ck^). 

n „ 

Finally, we have, then 

and 

<rl - + 2ZpO. 

7. Possible values of the pis, pk^ and <r|. Let us investigate brieSy the effects 
of different patterns of variation on the values of pit and dt. Now «« 

2 (®i - i)(aJy+M - 5). Suppose that x, « s,+« , 8 » 1, * * • , n - 1, 
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i = 1, • ■. , fc. Then (x, - J)’ n S (Ji “ Z - x)(x,,u - i) 

- (n — a) Z (a:. “ ^'Pon mibfititution it follows that pli « I, ami ffs « 

This result for o-J is intuitively clear, since all the variability is among the 
possible samples, and thus any particular ig^stemafic wimple is equivalent to 
one observation. 

Suppose, on the other hand, that x«4« “ ^1 » I, ' • ■ , A; 5 “ 1, • • • , 

n - 1. Then Z - i)’ “ ^ Z (y.+t—n* ” f"*" 8-«y *-1-" “ '' ' . 

IT 

z {Xi - *)(a:j+M - i) = ^ Z (j:.-+tx_m “ x)(T.,ai»~iiA “ Furthermore 
0 = [Z (a^t+(«~nfc ~ •*)]* Z fe-Ko-n* “ ■?)* + 2 Z (j^f+ci-n* ~ 

a a X-i 

— x). Hence 

2Z PM = — 1 and al » 0. 

t ti¬ 
lt is possible to construct examples in which any particular pm » « 1, hut in 
such cases the remaining pa each vanish. It is well known that the minimum 
value of Pi is — l/(n — 1). 

Finally, let us consider the expected values of pm and al if the x'r have been 
assigned their subscripts at random. 'These values are pa *=• —l/fnfc 1) 



In most practical applications of systematic sampling it will bo highly unlikely 
that the distribution of the x’s will be such that the x’h may bo said to have been 
assigned their subscripts at random. In general, there will he logical rcaaons 
to expect that the x’s will have some fundamental trend. '^Thus, information 
will often be available, or may be obtained by a small subsaraple, on the basis 
of which a decision can be made to use some approach differing from that of 
assuming the subscripts of the I’s to have been assigned at random. 

8. Estimates of the parameters. The formulae obtained in section 6 for the 
variance of the mean of a systematic sample are population formulae. Their 
values depend on the values of all the elements of the population. However, 
even in tests of possible sampling procedures, we rarely have available the re¬ 
sources with which to study the entire population. Consequently, it becomes 
necessary to investigate the possibility of estimating the population variances 
and serial correlations from samples. It will be shown that the estimates of the 
variances and correlations derived from a single Si are biased and inconsistent 
whereas it will be possible to construct unbiased or conastent estimates from 
samples of more than one of the Si. The sampling variations of these estimates 
must be left for further study. 

Let us assume that instead of sampling only one of the iSi, as we did in section 
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6, we sampled g of the S. at random. Then our sample would constat of all the 
elements in the . The sample mean, f. is defined by 

g£ == 

n 

if the subscripts of our sample classes are h , • ‘ , I'n ■ 

Then it is easy to sec that x is unbiased Furthermore, since we can regard 

this sampling procedure as the sampling of of A: elements at random, it follows 

Aj 1 i 

that crl = 5 - - - trl and, we have evaluated crl in section 6,'^ 

k 1 g 

Since 

hrl = ^ ~ x)^, 

1 

we shall consider estimating a\ by where 

gs] = 2 (^/5 - if- 

» 

Now, since E == a\ -{• x", and 


i 

it follows that dls; = <ri , and hence s] is an unbiased c'.stimate of al. Further- 

c 2 0(k "" 1) 2 

more §6?^ = --V- ' (r-. 

k - g 

We now' turn to estimates of the pa„ and f. 

Let 


gnf, = H (.r/j+(«-m - 


tf.a 


and let 




».a 




i)- 


Then, it may be shown that 
and 
Hence 


C c. 1 2 

^>5^, = cr — , 

~ Ckh “• <ri . 




“ It may bo wondered why we sample these H, at nvtahun rather than ayatemalieaily. 
If we sampled the S, systematically, it would be equivalent to taking a single syMtemalir 
sample having smaller intervals between elements of the sample. FurtUemiorc, wt* could 
not derive the unbiased estimates of the sampling variance that wc can now. 
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and 

■ 

The estimate, Tk,,, of defined by 

C "4 -V)) “ '■*" *' isik ~ d))] 

is thus biased but in many eases the bias ivil] l»e small Of eourse, if a ® ^ 

when n is even then r*„/!i is multiplied by 2 to estimate pm^ a« prenously defin«l 
Another approach would be to consider 

Q7i ^ j nit ' I 


and 


gnj:kn = (3i»+i«-in ~ ^/!)(J#+(»+;i“iu ~ •?«)• 

P,a 


When that is done, it follows that 


ar (j^ 


t 

«■») 


and 


& oikkif “ Ct,, — ffl, 


and 


S(j; + si) » <r\ 

S(u,cjt„ + s|) “ 0*^ ■ 

Another estimate of pkt^ is thus defined by the equation 


“f" 


tsTAfi[w^p “f* 


When e' = 1, 4 = 0 and we are unable to provide unbiased estimates of 
C]t ^, and ffl from the sample, However, since 


^ ^ “ ^*#<1 


1 Tkfi* 


it follows that approximately 


llL^ == 5 Lllti , 

1 Pkft* 1 Tkn* 

Since - Ck^g] ^ c . Similar equations hold for the „ri^. 
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When we estimate the pit, then the "within claflH" definition is Kinipler f/'t 
k{n — 5)u,c*jj = £ (a:>+(x-i)* — iiX,)(a:i+(x+j-i)* — where 




(,n — = 22x,f(x-nk) 


and let 


Let 


and let 


Then 


and 


(n — 6)u£i = Yj Xi+(\+i~i)k, 

X 

g(n — S)^Ckta = (ai3+cx~t)jt — it^fl)(^Kxtt-iu ~ 

p.\ 

( 

Ql/^kSc ~ ' '^)) 

t / , / 

Ckt = vCktt •+• tfikkf , 


S(wC*4, + hClcig) = Ckt • 

Thus, as estimates of the pU we obtain r *4 where 

ufikl0 "r Iffkit “* rjutuSj 8(). 

In cases where S is known simpler estimates of the pt^ , pit, and er* may Ive easily 


obtained since 


(•'rs+(o-l)t “ i) (Tj+(«4<i_l)i f} * (f^Ckti \ 


p,a 


SS (Tfl-KX-Di - «)(x^+(x+j-i)it - J) = gin-S)('[t, 




and 


(®8+(«-i)* — ^)* = SfTttr’. 


Thus, in pilot studies, when X is known it is possible to estimate the param¬ 
eters in O’* from even a single sample. 


9. Changes in the variance with changing size of sample. The chief mmm 
for expressing the variance of a systematic sampling design in terms of tlu‘ 
variance of a random sample and the serial correlation coeffieients wert* 

1. To enable the making of comparisons with random and other .nampling 
designs 
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2. To simplify the analysis of causes for the difference in the efficiencies of the 
systematic and random designs, and 

3. To simplify the making of estimates of the variance for different sizes of 
sample. 

In this section we are concerned with the third of thew* reasons. We shall 
discuss only the p*m since the analysis in terms of the pit is very Rimilar. 

The problem with which we are concerned is the estimation of the function, 
Pk, of k. In order to show how this may be done for all vahies of k when the 
Pk^ have been computed for one value of k, let u« first note that wince e® does 
not depend on k we may confine our considerations In the . In section fl 
we have defined by the equation 

knCkk, = Z ~ - ^). 

¥ 

Thus, if we wish to evaluate the C*-,.. where k' is such tliat k' yt k and JtV “ 
kn = N, y/b have the result Ck'„‘ = if k*ix' « kp and, thus, for any given 
values k' and p', we have 


C*>< » Ckk'^’/k 


where we have replaced p by 


k'p' 

k ’ 


This procedure will involve, if k' < k, some interpolation, but if the pv are 
plotted against p, this interpolation may often be earriecl through grapliically. 
However, it is usually advisable to take k so that the possible values of k' are 
such that k' > k. 

In some cases it may be possible to construct a correlation function. For 
example, if the x, may be represented by a polynomial in then pU may be 
represented by a polynomial in 6. Prom that fact we conclude that if the Xk 
vary about a smooth trend the p« will also vary about a smootli trend and it 
may be possible to interpolate. Further investigation of tlus problem is neces¬ 
sary. 


10. Stratified systematic sampling. In sampling practice it is customary to 
deal with stratified populations. The variance of an eatunate billed on a 
gratified population will usually not include the variability among the strata. 
Consequently, when a population is well stratified the variability of eatimatea 
b^d m a sample of size n will usually be considerably less than the variability 
of an estimate based on a random sample of size n, ignoring the strata. We 
now discuss the theory of systematic sampling from a stratified population. 

bet us assume that the population, P, consists of L strata, Pi, ■ • • , Pt 
the ath of which contains elements , • • • , . It is desired to estimate 

he anthmetic mean, £ of P, Let the arithmetic mean of P. be denoted by 

We shall consider two possible cases, the first of which is often used because 
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of the administrative simplicity of giving identical operating instruct inn.'' to the 
people selecting samples in different places. The result.^ of this .‘section will 
indicate when this method may be used. 

Sampling Procedure I — Suppose that ki = h — • k,. -- k, ami that the 

sampling procedure consists in selecting one of the integers, 1, • • , A* at ramlnm, 
each integer having a probability 1/A; of being Heleetial. 'Hien, if the integer 
selected is, for example, i, the sample of I\ con.sists of x„,, n , • • • , j«, i »■ 
Thus, there are exactly fc'possible Hamplcs, *Si, ■ ■ • , Sk , each having p^(^bah)lit.v 
1/fc of being the actual sample obtained by jierforming the sampling priK’erhm*. 

Sampling Procedure II —Tlie sampling procedure consists in stdecting one of 
the integers 1, ■ ■ , An at random, for each value of a, each integer having a 
probability of 1/Aa of being selected. Then, there are exactly ki • • ■ ■ * Ai, 

possible samples, each having probability 1/Ai.At of being the actual 

sample obtained by performing the sampling procedure. 

Other sampling procedures for stratified sampling, of course, exist-, llie two 
listed above, however, cover most practical problems except those involving 
cluster sampling. These will be treated in a later pai>er. Furthermore, from 
the conclusions derived concerning these procedures it will Ix' pfissihle to infer 
conclusions concerning other stratified sampling prwcdurc.s. 

Let Sai be the class of elements Xa ,, Xat+k , • • • , Xainn.-uk ■ We, consider 
sampling procedure I. A systematic sample of siw is to he sidecteil from . 
The possible samples are Si, • ■ • , S* where S, consists of all the elements in 
Si,, • • • , Su . Let the arithmetic mean of the elements in S„, he dcnuttsl by 
x„,. Let the arithmetic mean of the sample from Pa he denoterl by r„ anti let 
the sample mean be denoted by £, where 

Nx = iViJi + • • • + Ni^l . 


Then N&z = Z NMa = L fVa r E = A’^E. 

a 4 A/ I 

It follows from Appendix C, that 


where 


3 




ai6 




Although the expression for can be further simplified, the imptirt 4 mt fact 
is that if corresponding items in different strata are positively correIaU*d, jt is 
inadvisable to use sampling procedure I unless other considerationH than aampling 
error are dominant. But if the corresponding items are negatively correiated 
then sampling procedure I will yield a smaller variance than sampling proce¬ 
dure II. 
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We now consider sarnplinp; procedure IL Tlie diflfen*nee iwtween sampling 
procedures I and II is that in sampling prooedure II we know that ai,^ 0, 
if 0 7 ^ 6 because of thfl separate selection of sample in each stratum. Thus, 

under sampling procedure II, tri = 23 where ifl, has been derivwj in 

section 6. 

11. A comparison of the efficiences of systematic and random MmpUng 
procedures. The study of any sampling tcchni(jue, is incomplete unl«« some 
comparisons are made with other possible sampling U'chniques. In this section 
the systematic sampling procedure is compared with the unrestricted random 
and stratified random samplmg procedure. 

The means and variance.s associated with the random and stratified random 
sampling procedures will be, denoted by the use of primes (') and double primes 
(") respectively. 

Then we know that 

^(£--n) 

and consequently <ri < <r^ if 

E < -(rt - l)/2(Jtn ~ 1). 

If n is large relative to k, we may use -~^k m an approximation to 
-(n - l)/2(fot - 1). 

In order to make more specific comparisons, it is useful to aasume that the 
population elements x, are given by some function of v, and to aasume some func¬ 
tions such as 

X, = Ao + .4i r 4- • • » -f A* 
or 


X, = Bo + Ai sin ^ 4- Bi cos 

iV N 

4 " • • • 


4-A 


. 2jrlK' 

A sm ~j— + Bh cos 


2whi> 

IT’ 


and then to investigate the efficiencies of the various pMslble sampling proce¬ 
dures on the bases of such assumed distributions of the *,. It should be noted 
that the use of the systematic sampling technique involves the assumption that 
it 18 pOTsible to order the elements of the population in a logical way, and then 
use this ordering in selecting the sample systematically. 

We shall now consider several possibUities. Let us first note that if we ore 
samplmg but one element from a stratum then the variance of the stratum 
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sample mean is the same whether the sampling is random or systematic. On 
the other hand, it follows from section 10 that if we stratify the population into 
L strata so that a sy.stematic sample of size L ehoos(‘H the jth element of each 
stratum, say, then the variance of the mean of the .stratified random sample will 
be greater or less than the variance of the mean of the sysfernatie sample de¬ 
pending on whether the average eorrelation between strata sample means in the 
systematic sample is negative or positive. 

Let us now consider the origin of the warnings against the us*- of .nystemiitie 
samples from a population having a periodic distribution. If k is the perhsl, 
the correlation between the strata means of the systematic sample is +1 and 
hence the random sample is superior. However, if the period is 2k then we 
shall show that the systematic sample will probably have a smaller variance. 

Suppose that the period is 2k and that within two adjoining strata of siw" k 
we always have Ti = , .Ta = ist-i , ■ • • , Xk ~ ai+i and x, -- j- = ■- (Xi*,, — t). 

Then, if we are sampling one element from each stratum, the correlation between 
the systematic sample means, (the individual elements in this case), will be — I 
if the strata suhscripte differ by an odd number and d-1 if the strata subscripts 
differ by an even number. 

The variance within each of the n strata is e?, where 

k<r\ = E (X. - jy. 

1-1 


The variance between strata means is zero. Hence o-’ «« eri. 'Hie vurianee 
of the mean of an unrestricted random sample of size, n W’here «.»/*« then 

' ^ and the variance of the stratified random sampling mean is 


j N - 

tTl' = 


fV - 1 L 

^r^' = {1/L)(tI while the variance of the systematic sampling mean is 

<rl = t (-l)-'(2 - fio) 


where S,, = 1 if f = j and 5;j = 0 if i j. 

Then it may be shown that if L is even e’ = 0 while, if L is odd a* « i. 

Consequentl.v, the efficiency of the systematic sample mean is greater tlian 
the efficiency of the stratified random sample mean if the population has a 
periodic distribution and the size of stratum is half the jieritKi. It should be 
noted that the same situation holds for k equal to an even or txld multiple of half 
the period as held for k equal to the period of half tlie ijeritnl. 

The situation is quite different if w'c assume that the elements of the tiopula- 
tion have a straight line distribution. Without loss of generality, we nmy 
assume that the straight line distribution is given by x, = r. 'Ilien for nn 
unrestricted random sample of size n, the sample, mean being denoted by 
we have tjix' = S == i(kn +1), 

ill 1 

« n — 1 


3 

(T = 


12 
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and 


i (k — l)(kn + 1) 

-- 


For a stratified random sampling design, let us 8»ume that ,Vi 
where c may equal any of the integers I, 2, ■ ■ ■ , n; i-P. /v 


It 


tH 


n 


ni = • • • = at = c. Then <rr' “ 


c’ fc ~ 1 
n^cifc — 1 


crl where!" is the sample mean of 


the stratified random sample. If the ath stratum contains x^^ , , ■ - ■ , 


then a-l = 


ekr - 1 
12 


and 


av 


c k — 1 c*it* — 1 
n ck — I 12 


Finally 


<rl^ E S fc - 

knr I j 


= <r= - 


1) 


12 


¥ - 1 
12 


To summarize 


j (l;-l)(fot+l) (ifc-l)(jV+l) 
" '12 "12 


a _ c(fc - l)(cfc + 1) 
12n 

i k- - 1 
- -2- • 


(fc 


- 1) -h l) 


12L 


It is clear that both o-i and er* are less than <7*-. However ai/al 


L{k ■+■ 1) 


Since kn = N and cL = n it follows that fc = ~ and hence <r\ < <rr - if jV > 

cL 


L(L — 1) and c > 


L{L - 1) 


. In all cases N > c. It follows therefore 


1 - 


N 


N 


that for a value of c to exist we must have v r- 

L N 


NL 


as a result of 


L{L - 1) 

which we find that N must exceed 2L* ~ L. Hence sj < «t»m if iV > 2f/ — L 
c ^ • Otherwise <rj > <rl'i . 

1 N 




SYSTEMATIC SAMPLING 


IT 


This result follows from two facts; 

(1) If one element is being taken from each stratum then the high juersge 
correlation between strata means results in the efficiency of (he stratiheil random 
sampling mean being greater than the. efficiency of the sysU'matie satnftling nimti, 
despite the equal within stratum variances. 

(2) If more than one element is being taken from each stratum then (lie within 
stratum variance of the systematic sampling mean is U-as than the within stratum 
variance of the stratified random sampling mean and if the si»’ of stratum and 
sample from stratum are large enough, the smaller within stratum variance of 
the systematic sample more than compensates for the correlation among .stmt* 
means. 

Of course, in a straight line distribution there arc much more efficient methwlK 
of defining a stratified random sample than that we have us(*tL Furthermrm*, 
more efficient sampling procedures than those discuasiul art* available, How¬ 
ever, this example will be of u.se in indicating the gi'tieral prolilems that nn^' 
as well as the procedures that may be followetl in attacking them. 

Another comparison of systematic and stratified random .‘‘amplitig may tie 
obtained by considering the x, to lie composed of two elements, a tnuu! fimetiuu 
and a periodic function so that the deviations from the trend eotisIilut<* a 
periodic function 

Let X, = <p\(v) 4- <<h{v), where vuCi*) is a trend fimcliou and it* a [wroKhc 
function of period 2h, N — 2hQ. 

Let = y,. Then 2/^ = = • • • *= I, ■ ■ • , and 

VmA-j — 2/ = — (2/sa»+ii h — y), j = 1) • • • , /i, o =a 0, • *' , 4^ — 1. 

Since the sizes of sample that we shall consitler for purposes of tliis compariMUi 
are all multiples of h we shall calculate our variances and covariances so that we 
obtain all the necessary information at once. 

Let the mean of v>i(i') be denoted by ipi and let the mean of vjjfs) Is* «ienole«i 
by y. Then 5 = § and 

Na- = E (a:, - $f 

= X [sciCs) - i&il' + 52 (j/r - + 2 23 l<fJi(*') *“ yilfi/r •” gl 

" p f 

— 52 (iPKa-OA+i — yia)^ + 5!) (*?ls ~ V^l)* 

a 

+ 52 (2/(o-i)a+,' — + A 52 — 2?)’ 

n,i a 

+ 52 [v’Ua-DAfl “ - %) 4- A22 (^u - - m 

n.t a 

where o ® H > 2Q; f * H , A, is the arithmetic mean of v^h-* s iiK! , 
• ■ • , ipKoA] and is the arithmetic mean of , • • * , , 

It follows from the assumptions ivith respect to the y, that % ^ § and tlal 

2 - Vaf is the same for each value of o and is equal to 52 (K. ■" ff. 
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Since yi = j/w,+, 
we have 


n-n ixncl y^n 






A 1/ 

T, WiW - - 2?) = S (2/> “ #) 53 

»> ti“I 0“*1 

V 

+ 53 fj/. “ !/> 531 'S'® S ““ ^3.(9—||t 

- * ‘ 1 

'J'jUi/.' ■* 


- 2#A «t **” 1J 

ail .w 

„ fi/i ■“ i?) 

1 

Since y, — ‘Q = {y^^■h ~ P), we also have 53ti«'jfv 


53 (Vi ~ y) 153 [v’i((2fl “ 2)h + {) — <pi((2a — + r* . j ■?- vua ib 

r—1 \ow«l j 

which vanishes for example if (oi(v) is a straight line or if scile) if* a sueeeft*if>n of 
straight lines each having length 2h. 


Let us now assume that A -j- Bv. Then v!>i» “ --I 4* /t 

h + n 

2 J’ 

•piiia — l)h 4- 0 “ ?*i« ■“ i ^ ^ \ 


(« •" 1 th -f 


„ HW - n 


12 


53 [v>l{(o ~ l)/l 4* f) — ^laf “ 


r (»,. - .,)■. ’tmrjm, 

a 


ifii = A A~ B 


2h+ 1 


E M») - W - 1). 

Then a = (r„ + — — 1] where hcrl *= E (l/i ~ pf, and the variance of 

the mean of an unrestricted random sample at size n is vl- » *5 

.V -- 1 « ' 

Let us assume now that the size of stratum is mh where m i« a factor of 2<2, 
say 20/m = L„ . Then the variance witliin each of the strata is a constmt, 
2 

say, <rj where vi =■ vj + - (hV -- Ij if m is even. If m is odd then is avm 

and in half the strata the within stratum variance is v? 4- E (i/i ■" 
/ li + l\ Aw fci 

y) 2 J while in the other strata, the within stratum variance is 


2 

CTi 
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Then, if c elements are sampled at random from each of the hr* 
that 

5 _ 1 /mh — c\ (t\ 

L„ \mh — \} c 

OK "’+12 

In order to evaluate the variance of the syatematie sampling 
evaluate ^ (x, — Xj^uf = A:(a — 5)»« . Now upon HuhstitutinSf 

follows that k{n — S)aii — ^ (y, — t/jt-tif — 2BkS (U/ ■“ 

I I 

kin — 5)5V5^ ^ .rmore 

Then, if i is a multiple of h, it follows that XI iVi ~ 2/n(») “ * 

^ \ " "i iii 

if k is an even multiple of /i, then yj == Pj^ik and hence (t/j "" 

Finally, if A: is an odd multiple of h then, if fi is an wid riumhet J/i 
2(2 /j — y) while, if a is even y, — = 0 and hence 

X) (vi - P;+u)* = 4 X - yf 

I i 

-o’ 

if A: is an odd multiple of h and a is an odd number. Note that if ^ 
multiple of h, then n is an even number. Since 

vj = v’ - ^ X (n - S)bu 

nr i 

it is necessary to evaluate X (tt — 5)sw , Now, if k is an even mnJtipl** «f 

4 

it follows that (n — a)a« = (n — a)jSVa* and 

X (n - - B^k^fn X - X «’i 

> t ( 

12 

Hence, if k is an even multiple of h, it follows that 4 » o-* - 1 2 

On the other hand, if A is an odd multiple of /t, md ff * f***' 

we have (n - 3)su == (n - 5)BV»^ -f 4(ft ~ 5)4 while if«is even (« ■" " 

(n - S)BW. 


Hence 


i; «t!L<?0 + . 
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Hence, if fc is an odd multiple of h, it follows that 

- 1 ) 


2 2 — II a 

(7i = tr —-- —a 


12 


Then, if is an even multiple of h 


O'* = aj + ^ (fc*n* ” ~ " 1) 


= + -1). 

i?* 

and, if A: is an odd multiple of h, then al ~ 1)* 


Thus, systematic sampling will yield superior resulta if 

L 

L(L~1)' 


c > 


1 + 


120-1 

- I ) 


N 

Since -=■ > c it follows that for a solution, c, to exist, we must have 

Li 

12. Summary. In this paper we have presented the theoretical liasiR for 
systematic sampling for stratified and unstratified populations inekiding the 
derivation of the variances, a study of the possible values of the parameteis, 
estimates of the parameters, the effects of chanpng the size of sample, and 
comparisons among systematic sampling, unrestricted random sampling, and 
stratified random sampling. The paper contains for the case where the sampling 
unit consists of one element, not only the theory necessary, but in addition, 
some analysis of the conditions under which systematic sampling ought lie used, 
and formulas for calculating the variances. 

In later papers of this series, we shall present the theory of systematic sampling 
when the sampling unit is a cluster of elements, the theory when we assume we 
are sampling not from a finite population but an infinite population, each of whose 
elements is normally distributed, and further studies of various parts of the 
theory and practice of systematic sampling. 

Appendix A 

Values Assumed by Certain VariahUs 

In order to avoid repeating the limits of summation of variables, we shall gii'e 
these limits in this appendix. 
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TABLE I 

Values Ass^imcd by SubacrijiLs 


Letter 

The letter will afwume all integral vnliten frnni 1 tn 

% 

k 

X 

n — S 

j 

k(n — i5) 

5 

n — 1 

y, v' 

kn 

“ 

n 

y 

n 

a, m' 

ti 1 

rt/2if niseven, if n is mid 

a, b 

L 


The letter /3 wll assume the values ii,ii, • •' , ig 'where ii, • • • , i, are a wtertinn 
of g of the k integers 1, • • • , A:. 

Appendix B 

On the Limits of Some Finite iS'wms 

The difficulties that arise in the transformation of finite* sums are very hitnilar 
to those that arise in the theory of transforming multiple integrals, i.e., the effeets 
of transforming variables or order of summation on the, limita of sununatiiau 
Certain lemmas that have proved useful in this pajxT are prm'rit«><l separnt'pl.v 
here in a more general form. 

Let/(u) and/(u, v) be functions of u and v that are finiU* for all ptwible values 
of u and v. 

Lemma 1. 

/fe+fa-U* ; 1)*) ~ 0*) 

a»T i.X 

a <7 

Proof: Let a = X and let7 = X + 5. iSince I < a < 7 and y < n, the fMWiible 
values of 5 are 1, • ■ • , (n - 1). For any fixed value of S the possible values of 
X then are 1 to n — i since X = 7 — 5 and, for a fixed value of 6 Uic maximum 
value of X is determined when 7 >= n. With these limita each term of / on the 
left side of the equation occurs once and only once on the right side of the wpsa- 
tion. Furthermore, no additional term occum on the right side of the equation. 
Lemma 2. 

-lu ) * 2^/(x,, x,(u). 

‘ / 

Proof: I^tj = i + (X - 1)*. ^ Then j is a monotone incremiing function of t 
and X. The minimum value of j occurs when f = 1. In that case j => 1, The 
maximum value ofj occurs when f = it, X = n - i. In that ca««' j « (n - S)jt, 
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With these limits each term of / on the left aide of the equation oeeurs «nce and 
only once on the right side of the equation. Furthermore*, no lulditional term 
occurs on the right side of the equation. 

Lemma 3. 

ii «»7 

Proof: First apply I^mma 1 to , x, h, i *) and then afqdy lairama 

«<7 

2 to the resulting expression. 

Lemma 4. 

H [fix,) + /fe+u)l = in - 0 X) SM. 

s,i ^ 

Proof: Let m = j + hS. Then for any fixed value of S the minimum value 
of m occurs when j = 1. In that caae m =« ^ + L For any fixed value of i, 
the maximum value of m occurs when j = k{n — 5). In that caae nt «• nk. 
The letter m will assume all integral values from + 1 to kn, and hence, 

E/(.ri) + Ex(x,+i,) - T,f{x,) + E/(x-.). 

>.i J.) t.i im 

If we sum a from n — 1 to 1 instead of from 1 to n — 1 in E f(xm) we ace that 

E/(x,) + T,fM » ‘‘e' fix,) + Z fix.) 

+ ••• 

k k n 

+ E/(x,)+ E fix.) 

where the summations of Xj are terms of Zfix/) and the summations of Xm are 

t.i 

^ tfn—I) jlft 

terms of E/(x«). But E fix.) + E fix.) - E fix,) and hence 

Lemma 4 is proved. 

Lemma S. Let 

E/(Xf+(a-l)l)/(x<+(t~l)*) “• A, 

•.a.T 

Then 

^^nZ[mf-Z\fix,)-fix,,H)]\ 

** /•! 

^ = E [fix,+i«-m)f + 2 E /(x.+(«-m)/(x.K 7 -.i)ifc). 

a <7 


Proof: 



SYSTEMATIC SAMPLING 


23 


By Lemma 3 

2 ^ j fi^t-i(a--i)k)fip^t-\-(y—\)k) “ 2 f ) S(^s 4 ) 

i.ai 7 l*i 

<»< ? 

and since we have 

2/(a:j)/(a:,+it) =* /(a:/)’ + Kxs+tkf “ [/(*/) - /(-Ehw))’. 

the proof is completed by using Ijcmraa 4, 

Lemma 6. Let knj = Then 

If 

Ki) -“ fe) ? - •'I - fe) S 

Proof: This lemma is a direct consequence of Limima 5. 

Lemma 7, 

A = 2 U(x,) - If + 2E (/(X;) - ;jf/(x,-+u) - /] + hiT. 

r i.t 

Proof: From Lemma 4, it follows that 

A = nEfix^f - E llfix,) - If + f/(x,+«) ~ If + 2E I/(x,) - /)I/(xhu< - /) 

I' )■* /.» 

and henccj from I^emina 3, it follows that 
A = nZ,[f(x,) - If + nikf - (n - 1)23 (/(x») “ /f 

» If 

+ 2 2 :[/(xy) - /](/{xhu) - n, 

whence the lemma is proved. 

Lemma 8. 

■*(s) - - (e) ? - ■'!’ + (:|i) £ i/w - /I'A -...-)-h 

This lemma is a direct consequence of Jvemma 7. 

Lemma 9. Ifh> kn, let Xh equal . Let fin, v ) *» f { v , u ) i.e, / is sywmrtw, 

Then, if we let 

dft “ 12 fixi, Xj+h) 

i 

it follow6 that 

dkn'^ ** 1 

¥ 

Proof: Obviously 

^L/f(Xr , X,+kt) *= dw -f" B, 

P 
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where 

t n 

li = /(-^d » 

g»»J:(ii—4)+! 

Now, let A = p - (n - S)k. Then 

lir 

B = /(^ahh-d* I infiti). 

h-i 

Since Xh+u = a;*,and/(a:A+cn-D)t i ^>>) ® /(** i **,(«-d»). it fnllows that B dn.i 
and the lemma is proved. It is noted that the symmetry of /(u, i/) is nert'^wary 
as well as sufficient, for if f{x, , x,+w) “a;, — a;,+w the thecjrem i« falw. 

Appendix C 

Stralijied Sampling 

Let the population P consist of L strata /“i, • • ■ , Pi,. lA‘t .f Im the arithnictip 
mean of P, and Xa the arithmetic mean of I\ , Ixitlie the .sample witirnate of 
Xa , and let i ^ Caia. Then $x =‘ CaAa « A when* t‘'h ^ -ia, lA't 

a d 

<ri be defined hy aj = &{x — sf. Then 4 = f>(x ~ Af + (.'1 and hence 
it is easy to see that al = CaCt,(rj^t^ >f (A - ,f)’ where 

a,it 

~ Aa)(i, — /U), 

and if AC„ = Na, then 

(A - £)' S c.C 6(A, - J,)(At - A) 

a,If 

and cTj = CnCbffjjij 

a.b 

where 

o'Ln = ^(iii - ^o)(Jb -* £t). 

These formulae hold whatever may be the method used in samplinK the ith 
stratum. If S 18 an unbiased estimate of f and Xa is independent of 4, then the 
usual formula ‘fj = S Cjiri, holds. The formula for will, of course, dpfiend 

on whether a random, cluster, systematic, or other sampling procedure is used, 



ON THE PROBABILITY THEORY OF LINKAGE IN MENDEHAN 

HEREDITY 
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1. Introduction. If foY- a certain generation the diatril)uU(m of is 

known and a certain law of heredity is assumed, the distribution of gf'notypj*?* in 
the next generation can be computed. Suppose tliere are N dtfferent genolyfHw 

in the nth generation in the proportions a;)"*, ■ ■ • , lli"’ where 2^ xl"^ « 1 and 

denote by pl\. the probability that an offspring of two pnrenta of tyjxf* « «wid X 

N 

be of type i where X) pJx = 1 for all k and X, and p',x = pL . Assuming pan¬ 
mixia, identical distributions xi"’ for males and females, etc,., we can flerive 
xj"'*'” from by means of the formula 


( 1 ) 


X, 


(" 41 ) 


It.x-V 


(i » 1,2, ' < • A'), 


Thus if the distribution x,‘“^ is given for an initial generation we can deduce suc¬ 
cessively the Xi \ x”’, > • - for subsequent generations. Besides, one may wish 
to express the i!"’, for any n, explicitly in terms of the initial distribution xll**, 
i,e. to “solve" the system (1). A further problem consists in d(‘U*rriiininK the 
limitrdistribution of the genotypcis Urn x;"’ (i *= 1, • • ■ , fV'). 

Mendel’s heredity theory is based on some ingenious assumptions which jur* 
known as Mendel’s first and second law. They enable u« to define the {KX^iblc 
genotypes and to establish the recurrence formula (I); they will be explainwi and 
formulated in sections 2 and 3. It is well known that in Mendel’s tlieory it makes 
an essential difference whether one or more "Mendelian cliaracU'ra" am con¬ 
sidered. In the first case Mendel's first law only is used; there are witli rtwfm't 
to this character but N — Z different types and the rccurrencie formula (1) can 
be derived without difficulty. As early as 1908 Cl. 11. Hardy [6] wtabiiflhtHl the 
simple but most remarkable result that under random breeding a state of wruititi- 
rium IS reached in the first filial generation, i.e. x"’ x!“‘ (in geneml) but xj" * 

xj“ (n = 2, 3, • ■ • ,).* 

In the case of m S 2 Mendelian characters Mendel aesunusi intlepatdeni 
assortment of these characters (Mendel’s second law). However, witliin four 
years after the dramatic rediscovery of Mendel's fundamental paper [lOj, olwerva- 
tions were reported that did not show the results expected for two independent 
characters. T, H, Morgan [11] and collaborators in basic contributions, con- 


* See also [12] where the stability of the particular ratio lr2;l ie recogtii»etl. 
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eluded that a certain linkage of Kenes Wte to lx* URHumod/ TakiiiR tlixt tf'P 
starting point, the main purpose of this paper is to establish the bwu- recur¬ 
rence formula for the goncial case of linkage, to sol\'e the corresponding system 
of difference equations, and to detennino the limit distrilmtum of geuotytx-s. 
Throughout the paper '‘multiple allclcH” arc considerwl instead of making the 
frequent restriction to two alleles. This genorHlizatlon is. however, an obvi.wH 
one (see section 1)* 

In order to deiil with the general problem a linkage clistrilnUnm (I.nJ, m- 
troduced. This concept, which seems to be basic to the whole problem, refers 
to the probability theory of arbitrarily linked events (3]. The ermwer pr^f- 
ahilitics, (c.p.), defined by Morgan and Haldane are, notwithstandinK their high 
importance, not sufficient for our purpose. (They turn out to be certain mar¬ 
ginal dastributions of the l.d.) If, however, wi == 2 and «V = 10 (for two alleles), 
a case studied by W. Weinberg [10] H. S. Jennings [7] and R. H. Robbins [14], 
the c.p. is equivalent to the Id. But for tlic. general case the l.d. is needed and 
the desired results must be derived by other methods than e.vplicit computation, 
which IS feasible if m equals one or two. The original problem of inrlcpendent 
assortment appears, of course, as a particular case of the general linkage, This 
problem was completely solved in 1923 by H. Tietsse [15] in a very interesting 
but rather involved paper. The proof of the limit theorem given in the follow¬ 
ing pages for the general case is far simpler and shorter than the treatment of the 
particular case in the older paper and is therefore a simpler proof of Tietze’s 
theorem. 

After a brief consideration of the classical case tji = 1 (section 2), the problem 
of m arbitrarily linked characters is discussed in section 3 with a particular view 
to a clear statement of the biological and mathematical assumptions. The l.d., 
its relation to the c.p.. and some basic properties of both arc considered in sec¬ 
tion 4. Then, after a very concise consideration of the case m = 2 (section 6), 
the basic recurrence formula is established in section 6 from which we deduce in 
section 7 two general limit theorems. The main point is that the limit dis¬ 
tribution of genotypes is "uncorrelated” and equals the product of certain 
marginal di.stributiona of first order deduced from the distribution for the first 
filial generation. As a kind of an appendix section 8 contains the solution of 
the system of equations furnished by the general recurrence formula. 

In the second part of the paper an attempt is made to contribute to the lituar 
theory or theory of the linear order of the genes, from the point of view of prob¬ 
ability theory. Accordingly, the linear theory consists in certain assumptions 
on the l.d., or on an equivalent distribution which will be called crossomr di*' 
tnbuhon, (c.d.), and which is more appropriate for this purpose. (Sections 9 

* “To T. H. Morgan and liis associates and students is due the credit for opening up this 
new field of genetic research; and the small vinegar fly CrosophylaMelanogaster upon which 
most of their work has been based, has now assumed as great an importance in genetics os 
the famous peas studied by Mendel.” (Sinnot and Dunn, Principles ofOenelies, New York 
1939 .) 
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and 10.) In this connection in section 10 a prohabilily dcliiiition <if (In- 
tance” d^, of two genea is propoKcd which, far from being contradictory to Mot* 
gan's ideas on the. subject seems to formulate them inatheniatically; sthf *!)• ■ 
tanee d,j between two genes i and j is defined as the mathematical cYfx'i-tatnm 
of the number of crossovers between i and j). 'ITiis distance is td coorn^c additsv.- 
as it ought to be in the framework of the linear theory. 

A problem frequently discussed i.s whether the crossover probabilitioH arc 
independent of each other (this independence is not identical with MimdelV 
free assortment). Observations (.see (4a]) did not aw'm to sulwtantiatc this as 
a general assumption. Then it was concluded that there exists a .siecidlwi 
interference which prevents, i.e. diminishes the probaliility of eiossovers t«H» 
"near" to each other. (See also [13].) It seems to the author that observation** 
on interference should be interpreted in terms of approjiriatc a.Hsiimfifiotis re¬ 
garding the 1 d. or the c d. Again the remark holds that the r.p.'s are not sitflfi- 
cient for describing the situation. Hence in wclion 11 an attempt in mmle to 
understand “interference’' by means of the c.d., ota-eplitig however the linear 
theory. It is w'ell knowm that the explicit presi*ntution of consistent flejtendcfit 
distnbutions is not trivial (see e.g. [2]). Not many dilTerent f.V|w*'' of '•rtmi«- 
gioua” distributions are known. In section 11 two such .*v(’hetueK are propoKsl 
which, though simple enough, seem to correspond to tlie gem'rtil iilen of inter¬ 
ference. They contain as particular cii.ses the. ease of intie}>eiu]cid anrl the cn.’»e 
of disjoint crossovers. 


2 . One Mendelian character. Hardy's theorem. It will Is* helpful tu start 
with the simple and well known cose of one character mtriKlucing the biiHic ron* 
cepts in a way appropriate for generalization. 

Mendel recognized that the distribution of certain hercdiUiry attribultw in 
organisms is similar to the distribution of attributes in a probability distribution 
With respect to a Mendelian character each imlividiial is chariteterized by tmi 
elements called genes which represent two possible alternative.*!. Tfie eoiiir of 
the flower of peas is such a character, the alternatives being red and white. 
With respect to this character each plant belongs to one of the three tyj)**?.: 
red-red, red-white, white-white,’ These arc thnie different gerwtgpe^. In this 
paper genotypes only will be considered. The difference between genotyfies anri 
phenotypes and the related concepts of dominant and recessive ijimlilies wilt 
not be dealt with. This is an example of a Iwo-mlucd Mendeliim eharaet<*r, i.e 
a character for which only two possibilities exist or, iming a more teximieid term, 


’It will be osaumed throughoul that the indivitiuntH ccinHidrn-d are "dinliHd" -rhai 
nw"® ‘i'®/'"■"""p'oKy of the preceding example that the, only jwMihle tyfw mv HU. 
1 W, and WW; or, .iiaing A and a; AA, Aa, and na. Modorn re»t*a,reh hm* however reve»|e.| 
that aituationa ma.y arise whore " totraploida”. ''hoxaploida", etc. briefly •‘polyploida'’ 

with '"'’1 ““ 

' P'" Pb .Sfhbility 18 no longer reached in the first tilial gener»tion, 
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with two alleles. The ca.'^e of two alleles Ls mrwt fmiw'iitty eonsidercrl in the 
biological literature where the two piwaihilitiets eorrenpoml moffly to a dominant 
and a receasive, umility. There Ls, however, no thffieulty in enaiideriiig from the 
very beginning the general ease of mulliplr nihUH wlieo’ the ehanu'ter under 
con.sideration is assumed to he r-viihied, i.e. nuseeptilde ttj r different miuiifesta- 
tioas (e.g. r = 5 poasihli! colors of a plant). These r possihle rmliies may Ite 
di.stinguished )iy the r arguments, I, 2, ■ r* 

fn the consideration of only one Mendelian eliaraeler Mmdd’n jirH ktw only 
is u.sed which may be .staterl as follows; 

(a). With respect to one r-valucd Mendelian elinraeter each individnnl 
belongs to one of the r(r + l )/2 poasihle type.s, each ly{H* iK'ing determined 

( pr ais J ’ * * I \ 

— 1 * . ».) * 

1 / — 1 , • * “ I r/ 

(b). In the formation of a new individual each ptmml tranxmitw one of its 
two genes to the new individual, the other gene coming from the other parimt, 

(c). The probability for the. transmission of either gene is the sami* and 
thus equals ^ 

We wish to deduce the distribution of genotyiies in the {n + I)sl generation 
from the distribution of genotypes in the nth generation uiuhr (hr mnuinp(um of 
compute panmixia (random breeding). Moreover, assume that the given initial 
distributions of genotypes os well as the laws of heretlit.\' are tlie mmr fur males 
and femaUs/’ In computing successively the new distribution from the pre¬ 
ceding one vi'Q shall always assume that the distribution of individuals partici¬ 
pating in the process of procreation is the same os theii' distrihution when born. 

Let us denote a genotype by (x; j/), (i = 1 , ■ • ■ , r; y = 1. • • ■ , r). To fix 
the ideas wc shall assume through this paper that the gene x liefon' the semi¬ 
colon was tran.smitted by the mother, and the y after the semicolon by the father 
of the individual. In some cases which will he considered later this dmtinetion 
will be relevant. Denote by (a:; y) the probability of the type (x[ y) in the 
nth generation. Since the laws of heredity are the same for males and females 
we have w'"’ {x\y) = ly'"’ (y; x) and thus have for each generation a symmetric 
distribution of genotypes with r" probabilities whose sum is one. There is, 
however, according to principle (a) no difference between the types (x; y) and 
(y; %) and therefore it is preferable to group together these types, thus intro¬ 
ducing for x = 1, ■. • , r; y = 1, . •. , r; 


*’*"*(*! y) = y) -f- ty^"’(y; x) where x < y. 


‘“Itisaimpleat to deal with mere pairs of alternative conditions (alloles) but ft tlinory 
TQmaina seriously Inadequate unless capable of oxtonaion to multiple alleles.'' ((17| p. 224). 

‘ It IS obvious that wo may admit without any change of result dilteront distributions for 
males and females m the initial generation, as long as random mating takes place after¬ 
wards 
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Consequently there are r(r + U/2 such prut labilities; 

( 2 ') 1), e'’”(l; 2 ), r " ( 2 ; rq ■ ■ • r ^ ■ 

where 

(3) £ y) - I (n-0,1,2. . 

Now define aa l/ic prolmhilily lhat in ihr nOi gtnrralim o mnk ter it 

female) individual iranmitts llic gene x, ObviouKly we have: 

= \ X) + k e‘"’(2; Z) + ■■• + x) 

(4) 

■f* h X "H U + • ■' + I r? 

and 

(4') £ p‘"’(x) = 1 

x~l 

In fact, the gene x will be transmitted, if an indii'iduiil this geru" and 

also transmits it. The individuals of type (y; x) (or (x; y)) all fuwtwsy! the gene 
X and transmit it with probability J if y 5 »^ x and with prolmlnlity I if y -i x 
Besides, the probability of the tyixi (x; y) in the (n + list Ri'iieratiim in ob¬ 
viously p'"’(x)p'"’(y); 

(5) y) = p''”(x)p'"'(y) » ui‘" x) 
or in terms of the y'^^Cx; y) 

y'"^“(x;x) = fp'"»(x))’ 

y‘''+‘’(x; y) = 2 p'’‘>(x)p‘-(y} (x rl yK 

Hence by (4) and (50, e'"'*''’ has liecn expreascd in terms of e"'' and the n-eiir- 
rence-problem is solved. The distribution u''"'“*(x; y)(n fe 0) hIiowk '‘inde¬ 
pendence,” and is therefore known to be stable. In fact, computing in the same 
way p'"'*’“(x) we get 

p'^+^fx) = i-2p'"'(l)p"’'(x) + p‘’”(x)p‘"’(x) 

+ ^2p‘">(x)p'"’(x + 1) + ... + |•2p'•’*(x^p'’■(^t 

= P‘"’(x)-£p'’”(p) - p<'»(x) 

p-l 

Of 

(g) p''’'-“(x) - p‘’”(x) 

(n =. 0 , 1 , 2 , • • * ), (x w 1, 2 , ... r). 

This last formula contains G. H. Hardy’s famous result (5] iAal p^''*(x) is (hr mmr 
for all n\ 

= p'”(x) (n « I, 2, ... .) 



30 


Hn-r)\ OKIWINOKII 


and because of {5'): 

(70 (X i/. a 2, 3. • ). 

In case of only one Menddian property the distnlmtum nf yenofyjpr^ nftehfH a 
stationary state in the first filial generation, 

3, Basic assumptions in case of m Mendelian chametere. A nf\\ niiiiatitm 
presents itself if there is more than one ehararlei*. in ease of m rhara<‘t<‘rs a 
genotype is described by 2m numbers (Xj, • • • . Xm ; i/i, ■ - • , |/«i or briefly fx; i/J 
(e.g form = 5, r = 9:(l,2,3,4.fi;2,7.3,5,{n. lOietf ar»* primarily X ^ r®** 
possible types because on eacli of the 2m places any of the r rnimlH'rH ran l>e 
written, Now, if the tyjres (x, y) and {y, x) art* oonsiderts! as itienfieal genofy(»efi, 

r" 

the number of different gcnotytws reduces to AO *= 2 ^ ^ ***‘**'‘ ’’ ^ 

m = ItJVi = 3;forr ~ m - 2: AO = 10). It is essential fttr thenmlerstanding 
of linkage that in counting this way two types like (1,3; f>.~t rind <1,7; 5.3} or 
(1,1;2,2) and (1,2,2,1) are. considered as differcnl although in both e!tj««‘s the 
indnudual possesses with respect to the first character the gene pair 1.5 and \i ith 
respect to the second the pair 3,7. If no difference is assumwi iwtwwfi two .“Ueh 

/rfr - 1 . 1 

types the number of different genotypes reduces to A’s » ( A. !) (K.g. for 

r = 2:N = 4", Ni = ^•2'"(2" + 1), Afa ®= 3"; hence for m ^ r u 2:A'’ ^ Ifi, 
Ni = 10, Ns = 9 or for r = 2, OT - 3:Af » (14, A’, » 3fi, Xt ° 27). Which 
method of counting is the correct one? 

The answer i.s that there are but Nt different genotyptis if Mendel's second law, 
the law of independent assortment, is accepted. Then and only then there is no 
difference between types Uke (1,3:6,7) and (1,7:6,3). Under the assumption 
of general linkage however, these types must be distinguished, not as individuals, 
but with respect to their heredity properties, i.e. considered as parents of a new 
generation. Under this assumption there are in general A’l different types. 
This will be discussed presently in more detail. 

Let us first consider Mendel's original theory as contained in his first and. 
second law. Analogous to (a), (b) and (c) in §2 we now formulate as followa: 

(a) With respect to m characters the genotype of an individual ia char¬ 
acterized by m pairs of numbers. Two individu^ are of the same tyfie if to 
each of the m characters corresponds the same pair. Hence there are A\ « 
/r(r + 1)Y 
\ -2— j B^i^otypes. 

(b') In the formation of a new individual a parent of type (xi, • ■ • , x*; 
Vi, ’ • ,1/m) transmits to the offspring, corresponding to each of the m char¬ 
acters, one of the two genes which he (or she) possesses wth respect to this 
character. 

(c') The probability of transmitting any of these 2”" combinationa is the 
same and therefore equal to 1/2*'. 
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ConMcler t'.g. tho individual (1,2,3; 1,4,7); the paii 1.1 rMirrc.-.pimil'. tn tli<* 
character the pair 2,4 to the .second und 3,7 to the third, rndei tlje 
aHhumption.s of Meiidel'.s original theory tlu .4 individual i« of the Mune ty|H* with 
(1,4,.3; 1,2,7) and (1,2,7; 1,4,3), and of eourKC with fl.1,7; efr 

As m = ,3, it may transmit eight ei)inhination.s vvhieh in the prtH'cding eKninplr 
reduce to four, because the individual is homozygou.s in the iirsi ehiirtuder 
These four (;omhination.s are 1,2,3 or 1,4,3 or 1 ,2,7 or 1,4,7 each with prob¬ 
ability 2 X i = i. 

The distribution of genotypes in siiceessive generations under the iwJ^airnpfton 
of Mendel’s seeond law has been investigated by If. Tietze [1.^] who also con¬ 
siders the limiting distribution as n -+ «. His results will appear as a partirulnr 
case of our general coasiderations. 

In order to discuss the basic facts which lead to the idea of linkage let us for 
the moment consider the case m = 2 . .Soon after the redi.scovery of Mendel's 
work Bateson and Punett reported observations whic'h did not give the exiMSditl 
numerical results. To understand the type of such an oh.Horvation OHsuitie that 
a homozygous male of type ( 1 , 1 ; 1 , 1 ), (or any other homozygous tyja*, e.g. 
(2,3; 2,3)] is mated to a homozygous female of tyix* (2,2; 2,2) jor to any luimtw 
zygous type different from the first e.g. (4,5;4,5)]. Obviou.sly, in tliis cw there 
is only one possible kind of offspring namely ( 2 , 2 ; 1 , 1 ), (or ( 4 , 5 ; 2,3)), But 
if now One of these daughters is mated to a horaozj'gous male of the original 
type ( 1 , 1 ; 1 , 1 ), there are four kincla of possible offspring, namely ( 2 , 2 ; 1 ,U, 
( 2 , 1 , 1 , 1 ), ( 1 , 2 ; 1 , 1 ), and ( 1 , 1 ; 1 , 1 ), correaponding to the four combinations 
of genes transmitted by the heterozygous (dihybrid) daughter (or ( 4 , 5 ; 2 , 3 (, 
(4,3; 2,3), (2,5; 2,3), and (2,3; 2,3)]; and according to the idea of free awort- 


ment each of these four combinations should apijcar with tlu‘ same mlative 
frequency; }. But it was observed that the combined fretpiency of llie two 
types ( 1 , 1 ; 1 , 1 ) and ( 2 , 2 ; 1 , 1 ) was larger than that of the ty{H»« ( 2 . 1 ; 1,11 
and ( 1 , 2 ; 1 , 1 ) “The characters that went in together have come out together 
m a much higher percentage than expected from Mendel’s second law, vi*. the 
law of independent assortment” [ 11 ], Morgan, in his theory of (he gene calfwl 
thi.'i “tendency” linkage. The idea is that the two genes 2,2 and l.l which 
have been together in the maternal individual tend to stay together arul that 
nature has to make an effort to produce a so-called croeeing-mutr, i.e. ti sesparation 
of the genes “that came in together,”—such that a female of tyjw (2,2; 1,1) 
may transmit the group 1,2 or the group 2,1. In other words, the idm of linktm 
tmphes an influence of the grandparents. 

According to observation the percentage of crossing over \'arie*« from 0 tt» St) 
cent, i.e. from complete linkage to free assortment. It will appear liowever 
that m principle crossover-values greater than 60 per cent cannot b(> cxcludwl. 
It Avas also observed that the percentage of individuals of tyfie ( 1 , 1 : 1,11 rouab 
very nearly that of individuals of type (2.2; 1,1). as we would exj^t. In the 

Zr ( 2 . 1 ; 1 , 1 ) and ( 1 . 2 ; 1 , 1 ) are nearly equal, 

their sum yielding the crossover-ralio. Hence the four probabilitiw correspond- 
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ing to the formation of the f<«f tyF-a* 1.1", VI.2, \ l\ - 12 , 1 , !.I|, ani 
(1,2; l,l)areaf«umMi(olK? (! - ri 2.(1 - 2.r 2,Hn<i/' 2 JtpjmjwMani 

to notiee that these are at the *<wnp time (he pr(nt»Rl»iljt>w l!wt tbp feimk' nrf 
type (2,2; 1,1) (which wai« matetf to the bK*mt^»yginr« <f|.I; I !), traomit*tias 
groupa 1,1 or 2,2 or 2,1 or 1.2 respertivdy. 

^ , , , , ,1 t m\ -- 1 

In the general ease of m eharaetere there are 1 ,, ! « ^ rrfwow 

probabilities. In this rase Morgan a«»«rrirs hnlugf-graufm, each grtsip eeawMl. 
mg of m, elements with • m, samh that "thm* » Imkagf hetwmi the 


elements of each gremp hut th*(t the memWrs ttekmg»r»K u» tliffmuil linkage 
groups assort independently, in acconlanw with MendrlV witnd kw." IThis 
idea will be reconsidered in Ik'cUtm 4. 

If we now wish to solve twr first basic problem, i.e. to derive the dwtrihutiM) 
of genotypes in any later generation from an initial distnbutom td genotypes, 
then the concept of crossover prolmlnUties does not Kufiiw 'flm coraplcs 
possibilities which arise if Mendel’s second kw is no Itwigt'r Bcwptnl ae. univereally 
valid cannot be adequately descrilved in terms of ernwiiver prolmbililips. Or, 
more exactly: It will be seen that if m $; 4 the miswtver jiroliahihtiw are no 
longer sufficient, whereas for m » 2 and m » 3 this concept k geneml enough. 
For the complete description of the hereditary rowhnnwm m the general case a 
so-called linkage dislrihulion, Id., is needed which involves 2*" prolmhilitiw with 
sum equal to one. Let us define this tlktrihution. 

Consider an individual of type (aii, * • ■ , r*; yi, • • • , y*,) « ix: yS, where the 
X are the maternal genes, the genes contributed by the nmtlmr of the individual, 
and the y the paternal genes. Denote by S the set of tlie m numliers 1,2, • ■ •, 
m, by A any subset of S, and by A' the complementary aulwt A' H ~ A> 
Denote by liA) the probaMHly that the individual (jc; y) (rattmti^ the palvmalgfMi 

belonging to A and the iruilemd genes belonging to ri', Tlterf are I + m + 

-f ■ • • -f- 1 » 2" such subsets A and accordingly 2*' probabilitiM l(.'l) where 

(8) E f(>l) « 1. 

u) 

In accordance with the previously reported observations and with our asmimp- 
tion of equal conditions for both sexes one must assume that 

(8') HA) » 1{A'). 

conditions (8) and (8') reduce the number of freely dinpoaaiik valuf» of the 
B ribution to (2 - 1). The ^distribution i# a socallwl m-dinmnoml or 

mrvanale atemative which could also and occasionally will be denoted by 
il’ 1’’"' *< » 0 or 1. Thus e.g. 1(1,1,1.0,0,1) la the probobiUty 

+n ■ , 1 ^ > *• > 1 the genes contain^ in the germ oeU of 

ofC^mdividual (a:; j/). Here the set A consiste of the numbers 1,2,3.6, and A' 
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Analogoufj to the statement.'^ (a), (h), (e) of §2 anti (a'l. {tt'j, ft*') tif the 
section we may now formuiate the principles of MindrVs (hrary i>f herrrhi nndrr 
the assumption of a possthle linkage of the genes: 

(a") With re«peet to m Mentlelian characters an intlivithial is ctiHracferiJicd 
by two sete of niimliera each conaiKting of m nnmtiers, vi*:, ti , • • ■ , -r„ anti jn , 


I 1/m 


where 


X, 


1,2, ■ • • , r. If the tyjai of an intiivitluat ia tiesignalctJ 


hy (xj, • • , Xml i/i , ■ • ■ ) 1 /m) (x; 1 /) where x atul y denote the inatemal anti 

paternal contnbutioiifi reapeetively, then (x; j/) « (y; x). Hence tlierr are 
-Ml — + 1 ) types of intlividualK. 

(b") s (1)') In the formation of a new individual each parent (ransmits l<» 
the offspring one act of m genes. 

(c") For each parent, the 2" probabilities of transmitting any one of these 
2 " possible .sets are given by a linkage distribution K.-l) where A is a subset 
of the set S consisting of the m numbers 1 , 2 , • . m, and l(.-l) is the prob¬ 

ability that the transmitted set consists of the paternal genes belonging (tt J 
and of the maternal genes lielonging to A' ■== M “ . 1 , and /(At « If. 


4. Some properties of the linkage distribution and of the crossover probabili¬ 
ties. In the following we shall need rnargin.al di.stributions, that is jjartial sums, 
of the probahilities within a distrihution. In a u.sual notation: 


h{x\) = 22 £ ■ ‘ • 13 i(xi , xt, • • •, X*,),... m distrihvUioriH 

*J *1 *M 

Uiixi , Xu) “ 22 • ■ • S ^(xi, xi, • • •, x«). (distributions 

(9) 

Im- m~.l(xi, Xi, • ■ ■ , Xm-l) ** Z2 I(xi, Xj, • , x„),. m dintributtoiiK 


hi- .mixi, Xi, ■ > •, x„) * l(xi, xt, , x„). the original distrihution. 

These are general formulae for any discontinuous distribution. Hut if tlie dis¬ 
tribution happens to be an alternative, as the l.d., where x, takes only two i-alues. 
any marginal distribution can be completely characterimi by two subsets A 
and -Ai of 8 where A D . Denote by i^CAi) the sum of all possible linkage 
probabilities which contain all points of Ai and no point of A — Ai, If, e.g. m * 8 
and A consists of 1,3,5,G and Ai of 1,3,6 then IaIAi) « Um (1,1,0,!) * 
22 Kl( Xi ,l,Xi, 1, 0, Xi, Xu). According to the prtnioua notation we have 

as usual 

(10) ^^(Ai) = l(Ai), or li.j. m(xi , ' ’ • , ®m) “ l(xi , > • ■ , Xm) 

and 


lo(0) = 1, if A = 0 is empty. 
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We will use for the liakage distrifnition and thrir marginal dislrilnitititia the 
customary notations or these new notations, whichever is more convenient. 

As an immediate consequence of our definitions we get the ftdlowing proiH'rties 
of the l.d. 

(i) If (8) holds for any A than 

( 11 ) lAAi) IA (.A — j 4 i ). 

(ii) As a ameguence of (8) it follows (mth the mtalian (9)) that 

(9') h(l) *= f.(0) = i 

(iii) If c,y denotes the c.p. between i and j, then 

(12) Ci! = cji = f.'Xl.O) + i.,(0,l) = 2/.,(l,0) » 2/,y(0,l). 

(iv) For any three subscripts i, j, k the "Iriangular" relation holds 

( 13 ) Cij + Cyt ^ Cik 
and 

(14) Cl/ + c/t + Cit ^ 2. 

To prove this consider the marginal distribution fiyt(r<x/r»). From (H) and 
(12) we conclude 

C/y = 2 [f.yi( 100 ) + f.y*( 010 )] 

c« = 2[f,yi^(100) + fw(OOl)] 

cy* = 2[fy,iL(010) + f(yt(001)] 

1 = 2[f,yk(000) + liikiim + f(y*(010) + fiy*(001)). 


* It is easy to indicate experiments which should furnish the relative frequenciee corre¬ 
sponding to the l.d.: If a homozygous female (si x„) ii mated to a homo¬ 

zygous male (j/i, ■ ■ ■, i/™, j/i, •■•,1/m) where each x,- yt, the resulting ofTsprings will all 
be of type (ii, • •, imj j/i, • • •, j/m). If such an offspring is back crowed to (gi, • ■ •. 

Vi, ■■■ , Vm) there will be 2" different genotypes of offsprings, viz. (»i, * 1 , - • ■ , **; y, , 
Vi, • • • I Vm), (f/i I 1 ■ • ■, ; Vi, Vj I • ’•, Vm), etc. whosB frequeneiw am proiwrlional 

to the 2" values of the l.d., viz. to 1(0, 0, • ■ •, 0), 1(1, 0, 0, ■ ■ ■ , 0) etc. Suoh an experiment 
should give the same results for any two seta of »’8 and p's, Crhore i», of oouwo. the atatia- 
tioal problem how to determine the "best’' values of the l.p. from thwe obaervations.) 
In an analogous way n marginal distribution can be observed; Suppose we wish for m »■ 0, 

hi! ... The offspring of a cross between females (*i, »«, *i, * 1 , 

set , *,) and males (p, ,y,,y,,xt, a,; Pi, pj, pi, , *,) are of type (xi , * 1 , ft ; 

Pi. Vi.Vt.xt. xt). If they are crossed to (i., ... , ; xi, ... , there will be eight 

different types of offsprmgs proportional to the eight values of fi„ (,i, « . In this last 
setup the p. should be dominant and m the experiment, desoribed above, the yi should bo 
recessive in order to be able to distinguish between the phenotypes of the individuals. 
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Solving these equations with respect to the Z-values we get 

Z,jji(10{)) = i idj + c,k — Cjk) 

(15) UAOIQ) = i (dj + C;* - c^) 
l.MOOl) = \ (dk + Cjk ~ dj) 

(16) (.;t(n(K)) = H2 - r., ~ dk ~ C)k), 

Thence (13) and (14) follow. The condition (14) is of courH:* always fnlfitle4 
if dj ^ h but this restriction does not seem to he necessary. Fritm (15! and 

(16) we deduce: 

(v) 7/ m = 3, the sel of three c.p. cn, cu, cn for u'htch the tncquahlieu (13^, 
(14) hold IB eguivcdenl to the l.d. l{xi, Xi, xf) for which (8) haliiit. For wi >2 '1 the 
c.p. are no longer equivalent to the l.d. Another necewary condition for the 
c.p. will be derived in section 8. 

Now let us consider and characterize some important particular cases of the l.d. 

(i) Free assortment (Mendel). In this cose all 2" values of the l.d are equ.'tl 
and therefore equal to (^)'". 

(ii) Complete linkage (reported by Morgan and other authors). In terms 
of the l.d this means 

(17) 1 ( 1 , 1 , ••• , 1,1) = ((0.0, ••• ,0,0) - J or W.S') “ i 

Consequently, all other values of the l.d. are zero. It follows that alt c.p, tire 
zero because all U, (1,0) arc zero. (See also Theorem I, section 7,1 

(iii) Linkage groups (Morgan), In terms of the l.d. this means that {hr L<L 
resolves into a product of several distributions, e.g. 

(18) l(xi ,xi,--‘,x„)= f{xi, Xi)g(xa, X4, xs)/i(xi, x?, x«, x^). 

(There is no loss of generality in assuming that numerically consecutive charac" 
ters form a linkage group.) As f, g, and h are diatrihutions it follows with nota- 
tion (9) that “within” the groups: 

Ci2 = 2/(10), Cat = 2i7M(10), • ■ • , Cti = 2ff4((10), 

Cur = 2/){7(10), ■ ‘ , C*t “ 2hm(W) 

these crossover values are. ouitc arbitrary. On the other hand w'e havi- tHTauae 
of (9') 

/i(l) = /,(0) = (7^1) »■ gj(0) =3 /tk(l) m /n(0) « f, 

(i » 1, 2; / w 1, 2, 3; » I, ‘ * 4) 

Hence for the c.p. "among” the groups 

Ci 3 = 2 -^-^ = etc. Hence Cu = Cu » bb bh | 

in exact accordance wdth ^Morgan’s idea of linkage groups. If each group Coa- 
sists of only one element: l(xi , x*, • • • , x„) = f(x,)g(xi) ■ ■ ■ k(x^) it fallows 
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tliat/(a:i) = g(,Xi) ==■•■= » h for J-,.* 0, 1. hfn«* l(ri , ■ • ■ , « i(|i" 

for all combinations of the arguments ami we liave again frts* aa-Jurtinent. 

(fy) Groups of completely linked characters. CninhintriK ami generalizing Ihp 
ideas of (ii) and (hi) we may ai>eak of i groujw of rompletely linked eharaetera if 
vdthin such a group no crossover lakes place. Then the m, eharaeterw in each 
group act as one character. An e.vample will suffice. Supiniise m S) and three 
such groups, consisting of the characters 1,2, and 3,4,5, and 0,7,3 ,9 riwpix- 
tively, Assume that 

Z(ll, 111 , nil) = /(OO, 000,0000) » a, 1(00, Ill, 1111) » /(Il.OOO.OtKXll - Cl 
1(11,000,1111) = 2(00,111,0000) = Cs. 1(11,111,OOOfl) = 1(00,00. nil) « Ct 

where these four numbers are ?^0 and with aum hence all other prolmhilities 
are zero. It follows that the c.p. "within” the groups are all aero: Cu ■» c^ 

■ ■ = cis = ci 7 = ■ • • = Csj = 0 , but the “among” c.p. are different from zero, 
e.g ci 3 = cn = ci 8 = cj 3 = cji = cn = 2 Ci + 2 Cs and, with an obvious notation; 
Ci.ii = 2(Ci + Cl), ci,i,[ = 2(Ci + Cj), Cu.m =“ 2(Ci + C'l). 

A particular case (also a particular cose of (hi)) arises if the l.d, resolves into a 
product of some distributions such that thereis complete linkage in each of these. 
The “within” crossovers are then again zero but all the c.p. “among” the groupe 
equal 

6 . The case m ~ 2. It will be easier for the reader if this case, though it 
has been investigated before by several authors [16], [ 7 ], [14), will l>e prwntcti 
by means of explicit computations before attempting the general one where m 
and r are arbitrary. 

If m = r = 2 , the number of types (zi, Zj; i/i, yi) equals ten. The l.d. is 
completely determined by the c.p. cw = c and v.v., because 2 ( 10 ) = f( 0 I) » c/ 2 , 
2(00) = 2(11) = (1 — c)/ 2 . Now let , xf) be the probability tliat in the 
nth generation a male (or female) individual transmits the genes x\ , x% ; and de¬ 
note by p}"’ [xi) and pl"^{xi) the respective marginal distributions. Tlie formula 
corresponding to (4) then becomes 

p‘'”(l,l) =«<’■>(!,1; 1,1) +^">(1,1; 1,2) -py’a.l; 2,1) 

(19) 1 _ 

+ „<">(!, 1 , 2 , 2 ) -f. ly'-’d.a; 2 , 1 ), 

and three analogous formulae. To understand this, consider e.g. the last term 

of (19); it is the probability that an individual be of typo ( 1 , 2 | 2 , 1 ) or (2 !• 1 2 ) 

and transmits the set (1,1). By (19) p‘''>(z,, ;r,) is deduced from the 'given 
distribution y'"' of genotypes. 

W, as before, x and y are written for * 1 , a;, and Vi, Vi it is to be understood that 
then th™fi^ ~ = l/a • The relation corresponding to (S') takes 

y) = p‘"’(z:)p‘”'(x) if X = 1 / 

= 2p<”\x)p^^\y) M x^y. 


(20) 
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Applying (19) to the (n + l)st generation and using (20) we get the recurren«‘ 
formula 

+ (1 - c ) p ‘''’(1,1)7/'"(2.2) + rp '”(1 '• 

Here the right side can be rewritten ho as to give 

(22) p'-'^’d,!) = (1 - c)p‘"'(l,l) + cp{"’(l)prd) 
and three analogous formulae. Because of (7): 

(22') 7>'"'*''’(a:i, a:*) = (1 “ c)p'"’(xi ,arj) + cp['‘^(xi)pt^Hxt). 

From this recurrence formula, which has the particularly simple proi>erty that 
the second term on the right side is independent of n, it is easy to flerive step 
by step: 

(23) p^"’(xi. X,) = (1 - c)’’p^'’'(xi. T.) + d - d - c)"lpl'’'(j',)pd’(j-t). 
Hence, if c 0; 

(24) Urn p^"dxi,is) = pi'”(xi)ps“*(jj). 

n~*ao 

The preceding results were obtained by Robbins and JenningH. We will formu¬ 
late a theorem after having studied the general case of arbitrary m and r.* 

6. The general recurrence formula. Considering random mating and assum¬ 
ing general linkage, we now wish to find the relations which correspond to th«* 
formulae (19)-(22) in the case of m r-valued characters. It will turn out, that, 
by using the l.d., the following proof of the general case l>econM« surpriaingh* 
sraiple compared with older investigations of the particular case of free aasort- 
ment, the values of the Id. acting somehow as natuial ".separatora" for certain 
groups of terms. 

Denote by , ■ ■ • , Xm ; yi, • • • , p„) ® u)‘"’(x; u) the probability of a 

genotype whose maternal genes are the a; and whose paternal genw the i;. Then 
from (a")\ 

(25) te'">(x; y) = x), 

Writing X = 2/ if and only if x, = p,, (f » 1, • • • , m) we put jimt m in (2) 

(25') v''‘’(a:;2/) - w'"’(x;x), ifx « 1/ 

= •u)^''’(x; y) -b w'"’(y: x) » 2ia‘''’(x; y), if x y, 

^ A suggestive remark, repeatedly made by Professor S. Wright ataua lliat Ca*»umiri||; 
random mating) there can be no equilibrium until all of the factors are corahinei} ai ran¬ 
dom. This is indeed a necessary condition for stabiUly. 
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There are r^’" w^Yaluea and + 1) c^vnliiw* in racli g»<iif‘r;)ttn.)t» »hf- rt*-}w-ri!ve 

sums being always equal to one. Ihuiofo Ity p .j-i , ■ • , thr prit/nhtlUj/ 
lhai a male (female) individual of the nth (frnimhm tmtmnih }hr grtim am! by 

P.'rH-c., -Tj), • ■ ■ , , J-r.) - , ■ • • . j,) 


the corresponding marginal cii-strilnilionH, define*! ju* iiMin! d* f t. S«iiiietiniP« 
it will be convenient to denote mich a marginal dislributinn by •* p,(z) 

where A C S, and p^(z) is the mim of all p(r‘ eiieii that x, ^ fur all i i A. 
Following convention the fiulwcript will he timittnd uM A'; henee ps«) - p(s) 
and if A is empty, .1 = 0, the corresponding pi.iz) 1. 

To simplify the writing p(x), t)(x; y), etc. will Is* written instea*! *»f /* “ fx), 
2 /), etc. and p'(x), e'(x: tj), etc. for p'”*’'(xh ele. I’innlly, rememiher that 
1(A) is the probability that the paternal genes of .1 and tin* maternal genes of 
A' = »S — A will be transmitted and accordingly I aAi> is the (marginali prob¬ 
ability that the paternal genes of Ai and the maternal genes of.! - As will be 
transmitted. (S 3 A ^ Ai). 

Let us derive p'(^) from p(z). From the meaning of tin* diffennit distribiiliona 
we gatlier that 


(26) p(z) » Sf(A)ui(x; u) 

where A is an arbitrary subset of S and x and y such Oud 


Vi »= Zi for 1 « A 
X{Zi " itA\ 


In fact, the set z will be transmitted if and only if an individual iK)«(teaat>» thege 
genes and also transmits them; now consider any 1{A j i.e. the probability to 
transmit the paternal genes of A; this probability is to be multiplied by all 
possible la-probabilities which contain as arguments the fiatema! genes of A 
and the maternal genes of A', as stated in (aj. Xoiv let us write (20) also for 
the (n -t- l)st generation: 

(26') p‘{z) = 2f(A)ii>'(x; V). 

Next we have, just as always, [see (6), (20)) 

(27) w'(x] y) = w'iy; x) * p(x)p(y). 

Hence from (26') and (27) follows 

(28) p'(z) <= 7:l(A)p(x)p(y) 

with the condition of summation given by (a). 

The right side of (28) contains (2r)"' terms. Now we will write it in two 
different ways by collecting its terms under two different aspects: (i) arranged 
according to the marginal values of the bdistribution (ii) an-anged according to 
the marginal values of the p-distribution. Let us begin with (i). 
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The genes 2 i, 8s. • • • , 2 m can be transmitted only l>y individuals which 
each 2 . either before or after the semicolon or both; (either from the mother or 
from the father or from both parents). Hence, if /li and As are twtt disjoint 
subsets of S, the type of such an individual is such that 

X, 7^ Zi, Hi = 2, for all i t Ai 

(b) Xi^Zj, v,9^zs “ " jeAi 

Xk — Vk == Zjt “ “ k e jS — Ai ~ At, 

Hence the paternal genes of Ai and the maternal genes of At must be transmittwi 
and for the remaining genes either choice is admissible. Conftet|uentIy, each 
w'ix; y) in (26')—or, what is the same, each p(x)p(y) in (28)””i8 multiplied by 
the probability that the paternal genes of Ai and the maternal genes of At are 
transmitted. Now writing Ai -f- At = A this last probability is exactly the 
marginal probabilit 3 '’ Zx(Ai) = LiAt). Thence 

(29) p'(z) = Sp(x)p( 2 /)l^(Ai) 

where the sum is extended over all pairs cc, y defined bj' (b). This is a first 
recurrence formula, If in (29) w'(x; y) is written insh-ad of p{x)p{y) and then 
all accents are omitted we get 

(30) p{z) =• 2ie(a;; 2 /)iji(Ai) 

with the summation according to (b). Tliis formula is necmary in ortier to 
derive p{z) from the given distribution w(x; y) of genotypes. It com-sponde 
to (19). 

Now let us collect the term-s of (28) in the second way, I,et ua detennine 
the factor of any 1(A) in (28), e.g. of 1(1,1 >0,0,0) (where m 5 and A the Kuli- 
set 1,2). Any factor of Z(1,1,0,0,0) must be of the form p( 2 |, zt, ■, ,•) 
P( , • ,83 , 24 , 26 ) where all possible values of the variables must be; written era 
the empty places marked by points, and the sum of all these products is to be 
taken. Now, as in each of the two p’s on each of the free places all numbers 
between 1 and r have to be used, the sum of all these products resolves into the 
product of the respective sums of the p’s, In such a sum each term, on the 
places belonging to A contains the same fixed ^'alue8 z^ and on the other plaven 
any possible value combination; hence such a sum is precbely the ranrgiMl 
probability pA.(zk) = Pa{z) and the same holds for the. other sum of the p*« ami 
for A' = ,S - A. Thus wc get the second, even more important rw;urrmt» 
formula 

( 31 ) p'(z) « ^liA)pA(z)pA>iz) 

where the sum is over all subsets A of S, '^his formula corresponds to (22) 
and the limit theorem which will be proved in the next section is an ahnoet 
immediate consequence of (31). It is worth noticing that the derivations of 
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(31) and (29) from (28) are completely mdependenf of each other and that only 

(31) is needed for the limit theorem 

From (29) and (31) the interesting identity follows 

(32) £ * 2:p(j:)p(y;J>i{A,) 

!•«) 

which somehow reminds us of a general Abel-transformation. 

Let us summarize: (i) From a given distribution of genotype tr "" (or c‘"’) 
the p'"* are derived by (30). (ii) From these p‘"’ the w*'"*** follow by (2?) 
(or by (25') and (27)). (iii) Instead of step (ii), from p'"' the consecutive 
•• • , p'"’'’"^ may be derived directly by means of (31). Finally, 
if desired, follows by (27). 

As an illustration of these formulae let us write (31) for fn « 3,4,6: 

p'(*i, a:i, 2:») = 2tl(000)p(a;,, Xi, x,) + Kl0O)pJ“'(j:i)ps,(rs , i,) 

(310 + 2(0l0)pr’(2j)Pia(ii, x.) 

■f Z(001)pi"(a;i)pu(ii, xt)] 

p'(xi ,Xi,x,, xi) = 2(f(0000)p(i», , Xi, xt) 

-b i(1000)pl‘”(xi)p»4(xj, X,, X,) + • • ■ 

(31") + KU00)p«(xi, x,)pm(*i , xt) 

+ f(1010)p)i(xi, x,)Ps((xi, *«) 

+ 1(1001 )pu(xi, x,)pii[xi ,al,)) 

p'(xi , Xu Xi,xi, X,) = 2[f((X)000)p(xi, • • • ,Xs) 

(31'") + t(10000)pr’(xOp»m(x,, X,, x*, X,) + ■.. 

+ !!(11000)p»(xi, X 3 )pni{x, » f XftJ -f* * ' 

In the last formula the last group contains ten terms, As an illustration of 
(30) we write e g. for m = 3, r = 2, with p*"* = p and r'"’ = y: 

p(Xi, xs , X,) 3 u(xi, xj, X,; xi, X 2 , x,) + J[y(x,, Xj, Xj ; Pi , x* , x,) 

+ i>(xi, xj, X,; Xi, y,, X,) 4- ., 

4- ll»(00)u(xi, Xs, Xi; Vi, Pa, X,) 

+ J»(00)»(xi» X,, X, ; V,, x», y,) +. ...] 

+ f(000)y(x,, Xj, X, ; y,, pi, y,) 

+ [i(100)u(yi, xi, X,; xi, yj, y,) 

+ K010)i>(x2, yi, X, ; y,, X,, y,) H-). 
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7. Limit theorems. In order to find lim » • •' > "'f writ** the ivnir- 

n— 


rence formula (31) in the form 

(33) p‘"+'’(a:) - 21(000)p'"’(x) = Z'UA)pl'"( 2 )pl-’(cK 

(A ) 


Here means a sum over all Hubsets A of iS which are neither void nor equal 

to S. If. we write gi"’ for the right side of (33) and -- , 

21 (0, • ■ • , 0) = am the last equation take.s the form 

(34) "pfli ttpiPm “ Qfti • 

Consider first the case am = 1, or 1(0, • • • , 0) = 1(1, ■ • • , 1) » i.e. campMt' 
linkage, as defined in section 3. In this case all l(.‘i)“ValaeH on the right side 
of (33) are zero, hence = 0 and 

(35) pi""’= pi"’ (R « 0, I, 2, ■••J. 

This is exactly the same result a.s (7): All pi"’ are eciuul to pi” and Itecauw of 
(27) also 

(36) w'"’(i; p) = xu“’(x; p) or e‘"’(x; y) = i'”'(x: J/) (n -j'- 1,2,'")^ 


In fact, if the characters are completely linkwl, they act os one chartwtrr. flcruT 
we have 

Theorem I, If the m Mendclian characlrrn are rompklrly linkrtt, the (hutnlmlum 
of genotypes reaches the stationary stale in the first filial gerirralitm. 

Now consider (34) in the general ea.se where 0 ^ am < 1. Then the foUowiriK 
lemma will be used: If in a recurrence formula of the form (34), j «« <1 atui 
lim gi"’ = 5m exists, then lim pi"’ = pm = 5m/(l — n«). This can Itt* proved 

n-^« n-*oo 

directly in various simple ways, ft may also be regarded ok a conwquenep of 
well-known general convergence theorems. See also [15]. 

In order to apply the lemma let us first notice that pj exisU. In fact, 
p'"‘’'”(xi, X 2 ) — 21 ( 00 )p‘"’(xi, xj) = 21 ( 01 )pr'(- 2 i)pr*(x 3 ) and tt.s the right aide 
is independent of n, 52 certainly exists. Hence, it follows from the lemma that 
Pi exists For m = 3 the recurrence formula (31') show.s that pj"' ctmtains nn 
marginal distribution of p of an order higher than two; therefore each of the 
terms of 53 "’ approaches a limit, hence 5 s = lim 5 ^"' exiats. and connecjnently, 

because of the lemma, ps exists. We may continue in this way Ixtiuiw in (33 J 
all marginal distributions of p on the right side am of an order g m • • I, Hence 
for every m the 5 I"’ approaches a limit and conflequenlly the lim pm"' exwf«. 

Finally, in order to find p„ we notice that pj « (1 - a 9 )p!'’'(xi)pf‘(xri. hettw 
Pi = pr(xi)p 2 ‘”(x 2 ). Then, assuming that pm.j » pr’fxi) 
we see from (33), using ( 8 ), that 5 „ = (l - am)p*i'’*(x,) • • • pT(x^}. tikn* 
also (31') (31"), (31"').) Thence 

(37) lim p‘"’(xi, X 2 , • • ■ , Xm) =“ p{'”(xi)pj'”(xi) • • • pL^\xJ. 

n^oo 
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The last formula contains the limit theorem wc wished to prove. It can !« 
stated as follows: 

Theorem II. If m characters are arbitrarily linked, u'ilh thr tmr rxecptim of 
“complete linkage", the disirihniion of transniitlcd genes p (jj , ■ • ■ , x.,) “con¬ 
verges towards independence" The limit distribution is the prtHlurl of the m 
marginal distributions of the first order pl^'ir,), mhieh arc derived from 
p^°\xi, ■■■ , Km), the distribution of gametes in the initial generation. 

If, however, the initial distribution , ■ ■ • , x„) shows particular features, 
the stationary state may be reached ah'eady for a finite value ctf n. This happt'ns 
with n = 0 and for every l.d. if , x„) « • • • pif*(a:«»). In 

other particular coses it may happen under particular assumptiona for the l.d. 

Let us express the general result also in terms of the distribution of geno¬ 
types. It follows from (37) and (27) that 

lim iu^’''^^\x\ y) = lira p'"’(k)p'"’(2/) 

n“*«) fi—••0 

= pi^\xyj Pm'(K«)pr(t/l) Pm’il/m) ■=“ H \vT ^Vi)]- 

Now consider a product like pl°’(x<)p!*'(yi). By definition of p{*^(xi) and ap¬ 
plying (27) we find 

Pi\xf)pf'{yi) = S; • • I!) p'“’(a:i, • •', x„) ■ • • Y, , ••■.{/«) 

V 3 Vni 

*a'‘ rt.’ 

Introducing then in a natural way the marginal distribution: 


io\''\xi ■, yi) 

= Z Z Vt, ,y«) 

it is seen that 


(39) 


pS“’(x()pS'"(y,-) 


tcc“(xi; Vi). 


Thence the result 


(40) 


limw'"’(xi, • ,Xm ;yi, ,pm) 


: 2/i) • ■ • ta^,”(aj„ ; y„) 


which may be stated as follows: 

Theorem III. In case of m arbitrarily linked Mendelian characters the distri¬ 
bution of the genotypes in the nth generation, w^"\xi , • • ■ , Xm ; Vi, • • ■ , l/»), 
“approaches independence" as n -* <». The limit distribution is the product of 
the m marginal distributions i«J'’(x<; y,) of the ith character (t »» 1, ■ • • , m) 
m the first filial generation. 

This theorem, which may be regarded as a corollary to Theorem II, holds for 
any type of linkage, except “complete linkage” as defined in (17) where (36) 
IS valid. 
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8. Solution of the recurrence equations (31), I’orrmila !311 

, ■ ■ ■ , x„) in terms of , • • • , /«) (and all marginal fli’»Jrihtif stiji * 

of p'"””) and of the l.d. It seems desirable to try to exprean p”' >'x) in 
of Now (31) is not a single eciuation but rather a complex of 

difference equations with constant coefficients because for each margiimt dissnls! 
tion of order i < m the respective recurrence formula (31) of order t has to Is** 
used. (Or, if it is preferred to consider the marginal diatrihutionh as sums of 
p-values of order m, then all these p-values apjiear simultaneously and there is 
again a complicated system of difference equations,) In this situation it i« not 
to be expected that the integration will yield simple ex[)lieil fonmilai*. partic¬ 
ularly as long as the l.d. is left arbitrary. However, the construction of the 
following formulae is clear. They reduce to simpler expressions in particular cwitw. 

Let us use a method of indeterminate coefficients. To simidtfy the writing 
denote p^°\xi ,•••,!„) and its marginal distributions p!'"(x,), , xp, etc. 

by pu. .,m , Vi , p,j, etc. From genetical as well as mathematical considerafionA 
we gather the general form of pu.l.m in terms of po., „ and its marginal disfrihU" 
tions; that this is indeed the general form will be verified by our very rmnputa- 
tions Consider the set »S consisting of the in numbers 1, 2, • • • m and divide 
S in every possible way m two disjoint parts Ai and d?, none of (licm 
being empty, so that di + dj = S, then divide iS' in every powilde way iriUi 
three disjoint parts so that di 4- da -t- dj = iS', and finally S is divided inPi m 
disjoint parts each consisting of one single clement. Denoting the unkruiwn 
coefficients in a corresponding way by a.5"’, . ai;’,,.,,. etc. and writing pj*' 

and Pa for p^". and pJa!. „ the general form of v„ will be 


(41) 


pi"' - ai'‘’ps 4- S + 2 Ph, P^, 

0<l) 


+ • • ‘ 4* «u?i.....«Pipapa ' • • /!„ . 
This holds for every m. We get e.g. for m => 4 


(410 


Pl234 - ai2"34Pl234 d" (ai,234PlP2J4 4" ai.u4paPm 4- 


•) 


’) + «U.V(PlPjP3p| 


+ (au,34Pi2P34 4- ■•-) 4- (aia".3,4PiaP3p( 4- 

For m = 6, e.g., there are eleven different type's: One term then 

e^terms of the form ; 15 tenn.s like ala",Up.aPw. Id tcTiim tikr 

ma3,433Pu3P4«; IS^Jerms like al.l', 43 ,p,pap, 4 «; W) terms like ; 

15^ terms like an.uMPmiPii : 20 terms as a{.a.'j. 4 MPipjp 3 p« ; \B Imtn m 
nu.m3,ep,ap34p,pa ; 15 term.s as al.S.VowPiPapapiPw ; and one final term 

ai,i,3,4,s,opipspaP4P(P) . 

T derxmding on n and on the l.d. 

t w consider (31) and write for the valuw of the l.d. i-t innteiul 

° because no marginal distribution of the l.d. 

occurs in (31)). With this notation (31") e,g, rewis: 

(310 piJ'aV’ = vtpii^t + (alpiPsj"’ 4- *■•) 4- {cisPu’pi?* 4* 
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If there ie no ambiguity the upper m in n? may even be mnillwJ. Xuw a«»ume 
the equations (41) to he written for ^ 2, =« 3, • ■ • , m “ Intrwiuee into 

the left side of (31) the expression (41) for pi’"’ am! in the eame uay replace on 
the right side of (31) all pi"', pi;’. • • >, Pn‘ « by their resrKvtive exprfwirms 
(41). In this way an equality i.s oI)tained from which nH-iirrence fornmlae for 
the unknown coefficients may he deduced by colIcclinK all grotiiw of temw which 
contain the same products of p’s. 

If this is carried out, e.g. for m = 4, the recurrence formulae ar»' 

(n+U , *** 

01SI4 


Cit+U 

0123,4 


eoai?2.4 "h e4<*j[M 


(42) 


012,34 = I■'0tfl3,24 +• e»ai* On 


(ft+i) 

012,3,4 

(it+1) 

0 ], 2 , 3,4 


= yoa;!",a,4 -(- cuOii'oi."' d" I'lOtij'i Hh Ciaij.j 
= caOu,’j.4 + i'ioIm + * • • + i-i20i'"*oi.V + • • • 


etc. 


In general, i.e. for any rn, these recurrence formulae are of a cleAr structure the 
first one being particularly simple, namely 


(43) 


^(n+l> 

Os 


vtoit'K 


It can be solved immediately and gives 
(430 oi"’ “ eo . 

The other recurrence formulae are all of the form 


(44) = U 9 X„ + f{n) with xo 0, 

where }{n) is a given function of n whose general form is still to be investigated. 
The solution of (44) is 

(440 x„ = T,fMur'-\ 


With the notations used in (41) the equation (44) may be written; 


(44'0 


0^1,.4j, ..,,4,, — H" 




(n) 


We have to determine ,a, ■ Ifor reasons of symmetry and homogeneity 

let us introduce constants a}"' = = • • • = al"’ = 1. Witli that notation 

e.g. the last term in the second line in (42) reads uioiSVal"’ or the third (,erm to 
the right in the fourth line of (42); t'jait.laJ"’ etc. 

The construction of may then be described a« follows: Eacli 

. ^ 6um of 2'' ‘ — 1 terms, each term being a product of one e-value 

and two a’s. The set consisting of the p elements , 42, • • ■ , .4„ is to be 
f ™ possible ways into two non-empty, disjoint, complementary parts 
which form the subscripts of the two a’s in question; the subscript of v ia equal 
to the subscript of either of the,se two a-values; it makes no difference which, 
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because of the specific symmetry (8') of the l.d.; it should be* noh?fI that in fhe 
subscripts of V no comma occurs. As an example let us write A for m S, 
We get; = e8«8"'aisaVH7 + VuiotlleT OfjsaVs + t Ir if we wif*!! 

All,34.6,6 for m = G: A'sVs^.e.e = yaa6"'«ii'.Jt.6 “b r8«s"’alMt,j + I'ljais* b 


(n^ (n) I f n) [ n^ < ( aI in) i ’ n i >n 

Vuoin o:ij,6,6 + Wwtts.a au.ji + eiaeais.soh.e + 

Hence, in principle our "integration” problem, where n is the variable, i* 
completely solved: First pi"’ is given by (41). Then, in ortler to find an)' 
. 1 ,., we first determine the corresponding A by the role jnrt 

explained and illustrated, and then it follows from (44') that 


( a”) 




(44'”) 




A“1 


S Po""‘’'A‘V,.,,. 


This whole procedure, although in principle very .simple, may of course be lengthy 
if m is not small and if no specific assumption for the l.d. is conHiden*d; for in the 

expiession of .many different a-valiies apfR-ar, - each however with \pm 

than m subscripts—which play the role of abbreviations for eomplicatal rX” 
pressions; in other words the explicit solution for m =» (i, for instance 
the solutions for m < 6, all these solutions being however completely given bv 
our formulae, down to m = 2, where aij"’ and aj.?' are given by (Zi), 

Under simple assumptions for the l.d. the explicit expre.ssionK for the a Iwnme 
simple Two extreme cases are complete linkage and free assortment In 
the first case PisV^ = p{5! and notliing remains to he done. 'Fhe ease of 
free assortment where all v ~ can be dealt with (iiiretly by induetion, or 
we may evaluate the general formulae given above which in this ease heeume 
quite simple. We have“ 

(45) = 2"(2" - 1) ... (2" ~ M + 1). 

That shows that the values of the cocfRcients a'".’ depend only on tlu* ntimlHT of 
elements A, which appear as subscripts. Thu.s we find e.g, for in « fi, if we 
write in each line of (45') one typical value: 

- 272“" = l/2‘" 

®I,234M = “ (2" — 

«i.2,a46« = ai,2M6« = ao.o.aa = (2" — 1)(2'’ *” 2)/2'’' 

«l,??8,466 « a{2",U8,e = (2" ~ ])(2" - 2)(2" - .1)/2"' 

«u?8.4,M = (2" - 1)(2" » 2) .. ■ (2" - 4)/2‘" 

= (2" - 1)(2" - 2) • • ■ (2" - S)/2^". 

Thus in the simple case of independent assortment the explicit solution i« very 
simple too. It confirms the fact that lim ai.lVi.r e * 1 while all other an approavli 

S The values on the right side of (45) are indicated in lU, hot the solution for fr«>«* Mts-r*. 
ment reported in this article does not seem, to coincide with uur«. 



46 


HltDA OErRI.VOBR 


zero. To prove this, however, withouL ffrurrinpc to cumiMitatitMis, was the 
purpose of the preceding section, 


9. Crossover distribution and crossover probabilities. The limit theorem of 
§7 as well as the computations of the preceding welinn, in short, all investiga¬ 
tions and concepts considered so far, are valid for any l.d. We »lwll nntv define 
and use a crossover distribution, (c.d.), which is completely etiuivalent tti the l.rl, 
but preferable for the study of certain particular caac^. Apparently hinlogists 
have not considered the general concept of the c.d. but onlji’ the r.p. c,, , 'Dus 
concept is basic and tangible but not sufficient for a complete tleseriplicin of the 
linkage mechanism when m ^ 4, as was seen in the pnmeding ftections. 

It is obvious that, from our point of view, a mathematical theorj- of linkage 
must be based on the properties of and a set of assumptions on the l.cL, or the c.d. 
The linear theory will be considered from tliis standpoint. This theory is, of 
course, still compatible with a variety of particular assumptions. In the last 
section some simple particular cases will be presented and studierl wdth a special 
view to interference. 

The probability that an individual transmits the set of "paternal genes" !»- 
longing to A and the set of “maternal genes” belonging to A' «« <f? - A is denoted 
by 1(A), where 1(A) l(A'); e.g. with m » 8:1(1,0,1.1 A,0.0.1) « 1(0,1,0,0, 

0,1,1,0). Considering here the succession of arguments we see that in ei then set 
of eight arguments: The first and the second are from different sets, tire second 
and the third are again from different sets, the third and the fourth are from the 
same set, • • • the seventh and eighth are from different sets. Writing 0 far 
“same” and 1 for “different” and using these numbers to corrtrapond to the 
(ffi - 1) consecutive intervals between the m genes, we introduce; 

1(10111001) -I- 1(01000110) - T(nooioi). 

Here ir(rii, rn, ■ • , rim-i) where “ 0 or 1, is an (m — 1)-V8riate altenvative, 
The relation between the l.d, and this new distribution may be written in the 
form 


(46) 21(ti,«,,...,«„) = ,r(|ei-«(,lft-«,|,...|e^_,„«^j)^ «,«0orl. 

In this definition no fixed “order” of the genes is implied so far. The numbers 
1,2 ■ ■' m are used like names. 

But it s^ms to be admitted today by leading biologists that a certain natural 
order of the genes easts. If this is so the numbers 1,2, ... m should be used 

that the situation is in 

reauty shghtiy different: Only the genes withm each linkage group (§4) nr® assumed 

ufl for the moment 
consideration 

Delong to the same linkage group. 

Witlm such a linkage group a one-dimensional or linear order prevails, to be 
understood m the geometric sense of “location”. Some more precise definitions 
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concerning this linear order will be conRidered later. For the nimiienf wr dimply 
imagine that each of the two seta of genes belonging to an individual if* arrariK*-*! 
like m consecutive discrete points on a line segment f The crowover dial i il lU* e ni 
V 2 ,‘ ■ ‘ iim-i), introduced in (4r») becornp.s more meaningful under this a,".-ump 
tion where, now, the numbering corresponds to this linear order. Then the 
argument 0 in this distribution can lie interpreU*d as "eohei-enee’' and the nrgii 
ment 1 as “interchange” or “crossing over" and the ‘'intervals” !i» interval!* in 
the geometric sense. Whether this “crossing over”, which meanB transitttin 
from the maternal to the paternal set or vice r'erwi, is to be coneeivnl »,•» a 
“break” (Janssen’s chiasmatypie) does not matter for the above definititsiw. 
If however, the idea is that between two neighlioring genes not more than one 
break is possible then the “event,” which we call crossover, would lie at the 
same time a break; if, biologically, more than one break between i and (> 4* II 
is not excluded, then the event “crossover within (i, i + 1 )" means "wld num¬ 
ber of breaks within this interval.” 

Now, let us consider the relation between the c.d, and the c.p. It has been 
repeatedly remarked that the c.p. are not equivalent to the l.d., hence they an* 
not equivalent to the c.d. either. There are ^-mim - 1 ) c.p. liut 2”" ‘ -1 
Z-values, or ir-values. If m 4 the second number is greater than the lir**t 
Besides, the Z-values are absolutely arbitrary proliabilities. For the c.p. in m*. 
tion 4 some restrictions were derived. lAit us deri\"e another srt of r^xinrlunu 
by considering four numbers i, j, k, I which we may denote by 1 , 2, 3 , 4 . ('Hm 
following computation has nothing to do with linear ord(>r. It niipliea if m 1 
to the l.d. Z(«i€ 2 « 3 < 4 ) and if m > 4 to the restxu’.tive four-dimeriHitmal marginal 
distributions of the l.d.) Write = 2 Z(<l<le 3 ^^) and lei us adtl up the 

six c.p. corresponding to these four numbers. From c,, 2Z,;(1, 0 ) « i\,(I Jh 

we get 

Cl! + Cl, + • " + c ,4 = 3y(1000) + 3v(0100) + 3c(0()10) + 3i>((XKU) 

(47) 4 - 4t'(1001) + 4y(1010) + 4y(n00) 

= 4 - 4y(0000) - y(lOOO) ~ y(OlOO) - e((K)l()) - timUi -i. 
Hence as by (14) cu 4 - 02 , 4- cj, g 2 , it follows that 
^ c,( 4~ c/( 4* Cti ^ 2 

is another necessary condition for the c.p. The limit ” 2 " can Ik; rtmcliCfl, m nr 
see for y(OOOO) = r(10(X)) = y(OlOO) « y(001()) « e(0(X)l) 0 ; then 

cij e Cm « e(lOOl) 4 - !;(I0l()) 

C 23 « Cm =» y(ll() 0 ) 4 - y(ll)lO) 


Cl, = 0,4 « e(lOOl) 4- cdKXI) 


fiY,™ ^cP^cntecl M lyiagin a line like heiuls m n airing. The mimer»r«|t 

T.' ! ‘“•mngemont is (he only one llmliaroMiawm 

the results obtained [111 This is but one ofmany statemenlsin favor of the linMr ihe»rv 
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and 

Cl2 + Cii -h C|3 = €h + Cu + Tm “ 2, 


To summarize the facts about the o.p.: In case of m rhararitrs there are 
^m(m - 1) c.p. c„ = 2ii/(10) = (0,1). These mints mmt satisfy the foUou-- 

ing necessary conditions (besides 0 ^ c,/ g 1): 


(13) 

C, / "f“ C fh ^ Ctk 

for any tlinv aulwcripts 

(14) 

Cl/ -f C/i 4- Cl* ^ 2 

(f rr (r (C 

(140 

Cii + Cji -f- Cw S 2 

It It It 


If in an analogous way five or more subscripta are consiclereri no new* condition 
turns up. It has, however, not been provefi tiiat the above given npccsaary 
conditions are sufficient for a consistent system of c.p. If we w*igh to lie sure of 
consistency the starting point mu.st be a l.d. or a e.d. from which the c,, are 
deduced. 

[This question of consistency belongs in the same claw as tlie following problem: 

“Under what conditions does a set of distributions , x.) form the mar- 

^al distributions of second order of an m-diinensional distribution Ufj"!, • ■ * . 
*„)?’’ Here VCzi, ■ • ■ , !«,) is the probability that the first maull Is S Xj , the 

second g ij, the last g Xm . An analogous question arises for tli(‘ set of 

distributions T,yt(x,', x,, x*), etc.'") 

In the following it will be necessary to know the expresstoiie of the c.p. in terms 
of the c.d. Put m - 1 = n and denote by p ,, p „, etc. in the usual way the 
following probabilities derii'ed from the c.d.: p, is the probability of “suecesfl'' 
in the f-th trial, p,, the probability of success in both the i-th and j-th trial, etc. 
It has to be kept in mind that for the c.d. and all magnitudes derived from it the 
“j-th trial” is associated with the I'-th interval, i e. with the interval (t, f +• 1) 
“and success in the I'-th trial” means cross over in this interval. [Whereas in 
the 1 d. and in magnitudes derived from it, like c,-, = 1./ (1, 0) the subscript i 
denotes the i-th gene. (See (46)).] Now denote by Si the sum of all prob¬ 
abilities p,, by Si the sum of all pa , • • . Besides, let Fi, , ,,(x) be the probability 
d exactly x successes in the first i trials (t = 1,2, • • • , n), and analogously, 
Pi., iix) the probability of x successes in the j - 1 trials 2, 3, > • • , j, etc. Then 
the desired formulae follow easily: First we have obviously 


Cf.i+i = Pi (i stf 1,2, ■ ■ • , n). 

Because is the probability of one interchange between the genes i and 
1 + 1 i.e. of an interchange in the i-th interval, of "success in the i-th trial”. 


Si “ distributions 7.(a;) the question is trivial beottuaa any set of m 

s Tibutions yi(i) can be considered as the marginal distributions of first order of 7(xi , 

■ ■ ,^, 7 ,) = Vi(xi) • 
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Then c .,,+2 is the probability of one interchange between t and i ■! 2, i.i- of eitie-r 
an interchange in the first of the two intervals numbercHl i arul j i- 1. and no 
interchange in the second; or of an interchange in the Hcctind lutt nniie in the 
first. Hence c, ,+2 = P.,.+i(l), (i = I, • ■ • , n - U, because I\ ,ti(l' j*’"* fb- 

probability of exactly one “success" in the two trials munlK'rwl i and ? ^ J. 
In the same way we get Ci.i+a = . 1 + 1 ( 1 ) + Pi,,. i+}(3l, (f “ I, ■ • • , n ■ 2;. 

because an interchange between i and 1 + 3 means either e.vactly one (tr esacth' 
three interchanges in the three intermediate intervals. Hence we get altogether, 
with n = m — 1: 


Ci,i+i — pi 

(48) c,,.+2 = P...+s(l) 


Cim = Pii. n(l) + Pi2.,.n(3) + ■ ‘ • Pis. .n(n), wlicrc fi » n if fi ofld. 

=® n 1 if n even. 

Let us also express the Ci, in terms of the S,. It is well known (m* e g. 13]* 
that 

(49) Pi, .„„(x) = E (-l)'■'^‘?. (.r - 0, t. • • • HI. 

r—* 

Applying these to (48) we easily find the convenient exprtwions: 

C12 = Pi, etc. 

Ci 3 = (pi + ps) - 2pi5 s {Si - 253)12, etc. 

Cn = (pi + Ps + Pa) — 2 (pi 2 + Pis + pss) + 4piis 

(50) S3 (iS'i 253 4* 4.S’3 )wj , t*te, 
C16 = (Si — 2S2 -|- 4Ss — SSs)!.. 1, etc. 

Cl,m = Si 2S2 fi- 4S3 -j" ■ ■ • 4“ (— 2)"'Sm-l . 


10. The linear theory. Consider a linkage group of sisse m and arouine for the 
moment that 5 ^ c,* for all i, j, and k. It seems that the main mathemaliral 
content of the linear theory can lie summarized as follows; P in pamihk it> 
establish in a unique way an order or a succession of the germ, mich (hni for (hr 
/rn\ m(m - 1 ) . 

I 2y ~ .2 ~ inc<iualitm 


(51) 


Ci; <! C|,;'.i.i (t H 2, * • • , f7i 2) 

Co Ci_i,y (j 2, 3, • • ■ J m "■ I) 


hold, 

other 


In thi.s succession j will be between i and k if c,* i.s greater than the tw« 
c.p c,; and c,*. The two arrangements 1, 2, • * • m and m, m ~ 1. ■ • • ^ 
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• • • 1 are considered as corresponding to the same order. Furihrrnwrc^ thin order 
is a straight-Une-8V£cession for which an addiiiiT distance Trlation holds (cf. al.no 
[4a] and [13]). Instead of the restriction c,, Ca it is miffieient to awume 
the weaker resirichon, that tn any triple c,, , cu , cn, one is greater than the Itm olhern. 
Without such a restriction uniqueness of the order no longer holcls. E.g. in 
case of independent assortment where all c.y equal | ani' of the in: jKtssihle num¬ 
berings of the genes is equally admissible from the point of view of the linear 
theory. In the case of complete linkage where all c.j). are ssero it will lie logical 
to consider all m genes as located in the same point. Olnuously then' are all 
kinds of intermediate cases. We shall come back to this point at the end of 
this section. 

Now consider again the case of ''different" e.p. (in the above defined wnse). 
Let us prove that there can be not more than one succession for whieh (61) holds. 
In fact it follows from (61) that also: 


(61') Cij < ctk (i = 1, 2, m — 2) for all k > j 

and c.y < Ckj (i = 2, 3, • • • , m — 1) for all k < i. 


These are all together M 


2-1 + 3-2 + ... + (m ~ l)(m - 2) 


inequalities. On the other hand there arc all together « M/2 '‘iKitweon”- 

relations for m numbers, each of them being defined by two inequalitiea aa 
c„ < Cik and Cjk < c,* (if j is between i and k); hence on the whole M such in¬ 
equalities. But these are the same as (61'), as we see by changing f, J, k into 
j, k, i in the second equation (51'). Thus it is not possible to find two ciifFerent 
successions which both satisfy (61). 

As to the metric of the problem, Morgan proposed originally that the value of 
the c.p. c,j should be used as the distance between i and j. It has, however 
been objected repeatedly that this distance would not be additive; this is ob¬ 
vious^ since the triangular relation (13) holds for three subscripts (see also 
(50).'' The equality Cij + Cy* = c,* holds only in the exceptional cases where 
naultiple crossingover is excluded It seems, however that an adequate defini¬ 
tion of distance is available if we try to foimulate in terms of probability theory 
what the biologist had in mind. Ut j ^ i. The distance d,.;+i hetwem i and 
J 4- 1 may he defined as the mathematical expectation of the nun^er of crossingooers 
in [i, j + 1), i.e. in the j + i ~ i intervals between i and j + 1. Hence if 


8e°n«>tno equivalent of m points with «(m - l)/2 arbitrary distances we would 

fc Tn t In fnot it is well known that there are 

between fc pointe in the plane only 5, - 2fc - 3 arbitrary diatanooe, in apace only S, - 

«(m ^ C-- + Hence for r » m - 1 'and k » n,: L. - 
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p .,(x) denotes, as before, the probability of exartly x in thi-f* 

y 1 — t) intermediate intervals the formula liolds 

j+i-i 

(52) d„y+i = Tj xP,...,(x). 

Of course, an appropriate unit may be used such that in practical uw tlic 
becomes 'proportional to the (f,j introduced above. 

The mean value to the right in (52) is well known for any tlistribuliun 
ir(xi, • • ■ , X,) whether an "independent” or a general distributiem; (i.e. m mr 
case: with or without "interference”). Denoting in the usual way by 
the marginal distributions of first order of t(xi , ■ * • , and putting r,(I i 
p, = the probability of success in the f-th trial, we get: 

(53) = p. + Pi+i + ••• + p) 
and in the same way with k > j 

dy+i.t+i = P/+1 + Pm + •' • + Ph 
d,Mi = P. + Pm +•••+?* 
hence + dy+i.t+i = di.t+i > or in general: 

(54) dis+ d,k “ d,k {*■< 3 < 

It may be mentioned that the additive property of the raathcmaticftl cxjWH'ta- 
tion which was used here is very well known (particularly for indciicntlcnt cventi* > 
but not always correctly proved. The proof is contained in the transformation 
expressed in the following equalities: 

)+i-i 

d..i+i — xPi...,{x) 

XasQ 

d' x,4i -p ». ♦ -.p. Z;)s',,,yi, , * ■ • , 

*< *in xy 

= 2^ £ ■' ■ X (2:1 + Xi+i -f • - • -f- , xs, •' • , X,), 

*l In 

(For general distributions Stieltjes integrals replace the mim-s.) In 

f(xi , • • • , x„) is the given n-variate distribution, P . . the prohalnUty uf 

exactly x successes in the successive trials numbewHl i, and 

’Tm+i. Xj) is the respective mai-ginal distribution of ir{Xi , ■ - , 

The first equality in (56) is not obvious, while the second i« rather trivial. Fmm 
the second or third form of di,/+i in (55), follows (63). Tlie last expreswon rn 

(55) shows that the expectation of any such sum as (x, + x,+i + • • * can lyr 
computed with respect to one and the same, distribution xtxt 
Therefore the distance d,,y+i may also be defined as the expectcUian 0 / fx, 4* x, h + 
••• + Xj) toith respect to the c.d. 
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Because of the first equation (48) 'we get from. (53) 

(53') di, = Cj,.'+1 + Cf+i,i+s + - • > + C,-i.y . 

Hence the distance dt,is equal to the sunt of (he j — i tnicrtnedtalc c.p. No diffinilty 
arises for us from the obvious fact that always 

(53") c.y 5 dcj; and in general c.j < di,, 

because the distance di/ is defined by (52), or (55) and not as . 

On the right side in (53') stands the sum of certain c.p. We have rejicatedly 
remarked that there may be hitherto unknown restrictions for a eoiisistent sys¬ 
tem of c.p. Hence it is important to notice tliat //irrr arc no reslridims for the 
particular (m ~ 1) c.p. c,j, , • • • , They can Iw quite arbitrarily 

chosen because of c.,.+i = pi. Hence any geometric rcpresenialiim of m genrs 
arranged on a straight line in arbitrary distances (i ” 1, 2, • ■ • m ~ 11 is 
surely consistent. E.g. m consecutive genes may he arranged with equal distances 
djj = = ... = . Or some distances may tw zero; then the reatK-ctivc 

genes are localized in the same point, etc. 

Finally, let ua briefly consider the case of several linkage groups.. According 
to §4 the Ld. then resolves into *a product of several distriljUthms; e.g, with 
m = 12; 

, • " ) *ii) * /i(«i*a<»*4)/j(<s*8f7)/»(««<j‘io)A(‘u(ij) 

(66) = (i)V(| «i “ <5 1, 1 ~ *i I , ! *3 "" *» I) 

Tj(| tt — ««I, I te “ *71) ' ■ ’ <11 — tit D* 

Then, as postulated by Morgan, the linear order holds xoilhin each of the. k groups, 
whereas all c.p. among the groups are equal lo Iji. 

Let us conclude this section by transforming the basic conditions (51) of the 
linear theory by means of (48). This will be needed in the, following section. 
Consider e.g. the condition cu < cu , i.e. 

(570 Pud) < Pmd) + Pm(3) 

or Cm < Cm yields P 2 a(l) < Pi 28 (l) + Pi23(3). Or in the same way: 

(57") PuiH) + Pim( 3) < PlJ34(l) 4" PiJm(3) 

< Pi.3(1) + Pi...., 3 ( 3 ) + Pi, ..,( 6 ), etc. 

Thus we may express the content of (51) as follows; The prahahilily ikal the 
"event" happens an odd number of times in a set T, of i consecutive trials is less 
than the probability that the event happens an odd number of times in the set T,+i 
or in the set Tf+i each consisting of i + 1 consecutive trials where Tm and Phi 
denotes respectively the sum of Ti and cither the immediately following or Ike imme¬ 
diately preceding trial In this form we see again that the linear theorj' is an 
assumption, suggested by observations, and by no means logically necessary. 
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11, Some models of c.d.’s based on the linear theory. 'ITip. .“iniplisf'f jutd 
very important example which has been HUggested repeatoHy that of tnfh*~ 
pendent crossovers: 

(i) Independenca. 'Hhe crossovers do not influence* each other, i.e. 

(58) p,y = pfpy, p,y* « p.pyp*,’". 

That this distribution is consistent is well known; hence only the spefjfn* ine¬ 
qualities (48) or (67) have to be considertKl, Here the exprrswionf* /*» . 

used in (57) become very simple, c.g. with p, It 

Pi. .4(1) == viQiw* + <iiihm* + ai9>M4 + gi«hp« • 

Then a simple computation shows: 


c.,y+i - c.y = {qi - Pi) . -. (5^, - py_i)pi 
C-l.y - C.y = Pf_l(^i - pi) • • • ((/y_i - P^.,)* 

These differences will be positive if all ff. - Pt > 0 or all p, < 1. llenro; 1 
consistent c.d. which fulfils the conditions (61) of the linear iheorp ts the (hntnhuSian 
of “independent crossovers" with basic probnhiUlirs p, - m 

1, 2, ■ ■ • »i — 1), with the one restriction 

(60) c„H.i = p. g h 

The distribution is completely determined by (58). If all p, s-‘ p - wc Imvr- 
the particular case of free assortment. 

Although this independence is more, general than Mentlol's original awuttqr- 
tion, Morgan, Haldane and others reported observations, not in iirrordmtro 
with this hypothesis. One crossingover hc<>ms to prtwenl oUiers m a rortaiit 
“neighborhood". This phenomenon was named inlrrftrenrv. It huggf.st« that 
we have to consider the c.d, as a distribution of dcqie.ndent rather than of in¬ 
dependent events. This will be done in the following iioges. First etmrider 
the limit-case of: 

ill) Complete interference or disjoint events. In this case we hai't* 

( 61 ) Pa = P,jk = • • . = Pi,. = 0. 

Thence it follows that we have simply 


(62) 


Cf.i+J « p, 

C4,1+J » Pf •+• p4+l 


Ct'.iHs =* P> + p(+i -f- , etc. 

In this particular case the c.p, arc additive c., - d,, . It is obvious from utti 
that in this case the conditions (51) of the linear theory arefulfiM. tin do* iOb-r 

and onl ff " ^mmsUnt ,/ 

(63) c _ _ , 


-Si = Pi + p, + .. • -b p„ g 1 


(n a- ffl ™. 1 ). 
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This is in accordance with the fact that nearly or exactly additive r p. isave I wen 
observed always in connection with very small prvaluw. 

The most striking observation leading to the concept of intcrfcixmre wa« that 
P .3 ^ Pip 3 i i-e. that double crossovers appeared less frequently than one would 
have assumed for independent crossovers, but that neverthelesH the}' ditl a[)jwar 
sometimes. A particularly simple model of dependence or iriterferi'nee which 
starts with this fact, preserving however, the main Ktrueture of independence, is 
the following; 

{in) One-parametnc model of parlial inlerference. /Vjssuine as l>eforp (m — 1) 
basic probabilities p( and put 

(64) p., = tpiPj, puk ~ tPipipk , • • • , etc. (0 g ^ 1). 

There is independence if t = 1, complete interfertmee for e » 0 and partial 
interference for intermediate values of t. Let us first investigate conditions 
for the consistency of this distribution, Necesaary and sufficient conditions 
for a consistent distribution of arbitrarily linked events are well known (see 
e.g. [3] (b) p. 239), Write m — 1 « n. A system of p,- pi., „ is con¬ 

sistent if it is possible to compute from these (2" - 1) values, 2" non-negalm 
values w{7ii , ip, ■ ■ ■ i;„) (»;( = 0 or 1) which have the sum one and are given by 
the formulae; 

)r(H' • -1) = 

ir{ll- • -10) = pii„. - pu....,„ 


(65) r(iio...o) = p«- 5:p«,,-f SE 


(st) 


"I H 


PkU.n, 


± p«,, 


7r(00' ■ -0) = 1 - E P »1 + E S P«in, - ■ d: Pii...„ , 

»i wi 

Because of the symmetry of (64) it will be sufficient to check (66) by means of 
the relations (49) which can be obtained from (66) by collecting groups of 
equations such that the corresponding «-(,i show all the same number 

of Is as arguments. Write Pi,..,(x) = P, for the probability of .t successes 
in the n tnals where independent events with basic probabilities p( are con- 
3 analogous probability corresponding to the distribution 

(64) and introduce in the same way S; and S'i where as before, .Si » Sp^, 
Si = 2p.ji, etc. We then find: 

Po = 1 - -t- tSj 

= Po + (1 - *)(- Ss + S, - Si + ...) « Po« + (1 Si)(l - «). 

- «0(1 - 0 must be SO, Por « « 0 

S t^e ^ restriction at all. 

n the other hand this is the only restriction of this kind, because we find 

,Pi = Si - 2Si + 3S; - 45 ; -f- . ■. = Si _ 2«S, -f 3<S, ~4«S,-f.'-< 

- Pi + (1 - t)(2S2 - 3Si + 4S4 •• •) = Pj( + 5i(i _ 
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This last expression is always SO because of Pi S 0, Si S 0, * S 1. I'lirtliri' 
more we find for i S 2 that P; - P.t, hence always non negative. Tln'rpfoTe 
our system is consistent under the one condition (66). 

The additional restrictions corre.sponding to the Unear theory htt%e <»< K 
considered. A simple computation yields the result 


(67) 


C.,;+l - Cij = (1 - 2ep,)(l ~ 2<p,+i) ... (1 - 2tPi xlPp 
ct.iM - C<+ 1 J +1 - Pi(l 2 <p,- 4 ,) ■. (1 “■ 2tp/). 

1 


These differences are SO if p, g ^ which is, for f < 1, leas strong than (fifth 

Hence we sum up: A consistent model of partial interference with one pammrtcr i 
to fit the observations can be obtained on the basie of n — m —* I pn^ 
abiliiies P\, Pi , ■ • • Pn by meons of (64), if ilie condition 


( 68 ) 


Po« + (1 - >Si)(l - «) ^ 0 or iS, S 1 + 


holds and the additional restriction required by tfic “linear theory" 


(69) 


. 1 


is satisfied. For < = 1 this reduces to “independent events" or “no interference" 
mth no restriction (68), and (69) reducing to (00). For « « 0 our model ytelds 
“complete interference" or "disjoint events" with restriction (68) Intemung tfWl 
and no reslnclion (69). If we say that this model contains one jJaraineter only, 
the idea is that the pi are to be identified with the baaie c.p. r<,,n . It, might, 
however, seem adequate to consider « and pi, • • • , p„., as m available pamin- 
eters which may be determined from the observations by some appropriate 
method. 

(w) An (m - l)-parametric model of partial tnterference. Numerical data 
show (see particularly [4]) that interference is particularly marked i.e. p,, < p.p, ^ 
if the corresponding p<, p^ are very small, whereas for greater values of tin* p, 
we have more nearly the pattern of independence. This is lather a striking 
fact, and seems to be well confirmed by observaUon. In these final j»gw a 
model will be studied which takes into account the circumstanee that the amwint 
of interference seems to depo,nd on the magnitudes of the p, , It wmtww 
(m - 1) parameters, is therefore rather flexible, but neverthclwi very riwple 

Assume m -- 1 » n numbers where 0 S S 1 and form by means of n 
probabilities pi : 

(0 g «i g 1) '(t « 1, 2, , n|. 

We may choose small if the corresponding p. i« «mall and larger if it, ia Imm; 

ri+W ^ magnitude the e’s nml not differ much 

eitner. then we simply define: 

(71) 


Vit - f<Pi, Pijk ~ PiPjPk, 


Pn. 


PiPt • 
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Let us investigate the consistency of this model. In analogj' to (66) we form 
with Si - Sp,', Si = Ipi, St ~ ^ptpj, etc.: 

Po = 1 — Si Bt — Ss + • ■ • 

(72) " " 

= (1 - Si + Sj - Sj d—) - 2 (1 - (>)p, = Pfl" Xi (1 - t,)pi 

t~l l~( 

where P'o and Pa are the probabilitie.s for ?ero succeaftes for tlie mtKiel under 
consideration and for independent events with basic probabilities f, re«fH‘rliveIy; 

n 

hence Pa = H (1 - «,Pi) and we get the condition: 

1-1 

(73) n (1 - f.'P<) ^ Z) (1 - ti)Pi or: Z Pi S Z ?. + II (1 ” /ii)- 

1—1 I—i i—i I—T 

if all €, = I there is no restriction (73). while for t, = 0 we find again (63). The 
consideration of Pi, Pj, • • • yields no new condition, becau.se we get, denoting 
by P, the probability of i successes for the independent events with baaie prob- 
abihties p, ; 

Pi = <Si — 2S2 + 3S3 — ... ± nSn ~ Si 2S1 -f .. • nSn +' Z ~ *1) 

1-1 

n 

= Pi + Z P«(I — «i) S 0 and: 

1-1 

P'l = F.' ^ 0 (i g 2 ). 

As for the restrictions imposed by the linear theory we find: 

~ c,/ = (1 - 2p;)(l — 2pi+i) • • ■ (1 - 2p,~i)fi + Pf(l — «,) 
c..y+i - c,+,j+i = p.(l - 2pi+i) ... (1 - 2p,) + p,(l - If). 

Thus the conditions of the linear theory are satisfied if 


(75) 


pi S \ or pf S 


2e.' 


Hence summarizing: On the hasis of m ~ 1 jirobabililies p, a consistonl model of 
pariid interference is obtained by means of (70) and (71) if ike condition of con¬ 
sistency (73) and the conditions (76) are satisfied. 

It may be that the four simple models described in this section will seem too 
crude for the description of the complex mechanism of linkage. They could, 
of course, be combined and modified in various ways in order to Serve at least 
M an approrimation to the theoretical picture of reality we wish to construct. 
But while these particular attempts may be inadequate, it seems to the author 
that the underlying principle is not wrong: that a mathematical theory of 
linkage must finally consist in statements on the l.d. (or the equivalent c.d.). 
The consideration of the c.p. is not sufficient for this purpose. The mathe- 

rtoCrSuL***”“• *“ “-“'y 
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THE COVARIANCE MATRIX OF RUNS UP AND DOWN 

By II. Leyen'K and J. Wolfovitz 
Columbia Universily 

1. Introduction. Let ai, • • • , a„ be n unequal numbers and let tbe .*eeq»U'net* 

S = {hi, hi , hn) be any permutation of Ui, ■ ■ • , a„. »S' in to run‘«idi'red 
a chance variable, and each of the n! ixjrnuilations of oi i» aitsignwl ibe 

same probability. Consider the sequence R whose i"" elemenl w tlie sign ( I- or 
-) of h.^i - ft,, (t = 1, 2, ■ • • , n — 1). A sequence of p eonwrutive f aixiia 
not immediately preceded or followed by a + sign is esUed a run up «)f length 
P) a sequence of p consecutive ~ signs not immediately preeciliHi or followed by 
a ~ sign is called a run down of length p. The term "am" wilt denote, liotli 
runs up and runs do^vn. The usage of the t<'rn\ "length” variw; mo«t quality 
control literature attributes the length p + 1 to the runs which we aay ar<> tjf 
length p. 

As an example of our usage, the sequence 

-3 = 28 13 1347 

gives the sequence 

- 

which has a run up of length 2, followed by a run down of length 1, followerl by 
a run up of length 3. 

Runs up and down are widely used in quality control and have treen applied 
to econonaio time series. The purpose of tWs paper is to obtain their varianow 
and covariances and to correct some erroneous notions prevalent in the. literature 
about their application. 

2. Notation. If the sign (+ or —) of (/i{+i — h,) is the initial sign of a run 
defined as above, we call h, the initial turning point (i, t. p.) of the run. Then 
hi is always an i. t. p., and we adopt the convention that A, is never an i. t. p. 
We define new stochastic variables as follows: 

(2.1) s, = A is an i-1. p., 

\0 otherwise, 

(2.2) Xj,i = i. t. p. of a run of length p, 

” \0 otherwise, 

(2.3) w-f = ^ P‘ ^ of length p or more, 

(0 otherwise, 

for i = 1, 2, • • • , n. Also 

(2'“^) r = the number of runs in R, 

(2.6) rp = the number of runs of length p in R, 

(2.6) Tp = the number of runs of length p or more in R, 

Evidently r = g a:., r, = g x,,, and r', = J w,,. 
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if ,\ Mt>5 i 3'^'; /►■.Y ■ *ini<iU> thf m™ii of 

ti," ' ; \ 3i .mi'! <?' X . rifiinf*' till' variance of A', if they 

r%v>'i Bv ‘K«' !. !>ui> -Ji <'f A '»»■ ehall mran n funefinn /(jrj micIi that 

P'X * -s'' / ‘ • 'h*' '’-Tnf.-'l r, ! rlennt/f. the prnliaftility of tlie re- 

la!5'4i 5T hr 


3 . Pteltmin*fv fnmtnias. Jk’ 5 '1^ a v(»<haf>t!e vanaftle with any etmlimionti 
♦Isitnl'Jifn'H i-t; "j*.?. v f -- , 'ji . i/«t fa* « wjitenre nf n indp- 

{s<n<hni .l-wT-,ft?-'.!/. ■ 1 ' j,,] ' <>. It r j;f,J !, 2. . /i), 

I}).- -'I rns ■ ’.p .if -I 3 -ws* jn 5’ j» evidently thf .-.wie an that in S, 

Xn*' »In'.-'*-"* / 'j *• • " 

f 7 " ‘1. ■> «ri, 

f”, d "• V <• n, 

■ I. >v 3*. 


Tftrn 

f'V. ' *», 




1 

n' 


Ity 

f I f. ■“ (f* 7. - v» V, * f’Jy. ! 3> {/, j/inl I, 

u ^ 2, ft, 1). 

“* I- f " ** 

It w»H !*«• • !'»•« dVi ip.n5sn»**’ of the tyjietv 


a.i.' 



i 



• • fhjif 


iHpiif**' 

ik + jpj:' 


r - J - j %, ■•• 


FfWn ll»e fael tl,i3l 


r .f'.-.. .-w-r-r 


djt'B “' * dtv 




«!«.» r, - .! 3 ' 7.7 tji J. • ■ , p f f \ tl rm !>« tvhown that 

r - i: ■■ 1''^'^, ’^r,f * M + 

£>j; <4- 4 '- *1* rp)- 


V'* J *3 1 

,ts ' ' ' sp *' k; - rllrl* 


\\V xfiijJ! 


!-tf I r I I dMiHf ‘ 

«* - A- '■ r h 'rl' 
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Making use of the relation, 




n(n - 'l~ 


(i < n). 


we have 


Similarly 


tvdy,,, 

Jd 


(P + fc+l)piJtV 




4. CovariMces of runs up and down. We first eompuU^ /!,’(r,) and Eirj 
We define the symbol ^ 

-1 = > 2/, < 2/.+1 < •■• <J/.+, > 

The value of the right member is independent of i whenever it is defined fi r 
I - 1 > 1, i + p + 1 < n). Now 

EM = _) +P(+, _»-,+) „ 2Pj-, V, -1 

rvi+p ^v<+i /•! , 

(» =» 2 , 3 , n ~ p ~ j). 
£?(«;,,) = 2P(+'', *-) and 2P(~, +«), 

By symmetry £(x„,) = E(xp,M, the common value being 2 ^ ^ 

E{xp,) = 0, (i > n - p), (P + 2)! 

Thus 


^ (S *'") ~ + (n — p - 


2) £(»„,) 


(4.1) = 2n 1 _ 2 P' + V - p - 4 , 

(p + 3)l ^ (^“gyp™™. (p<n-2), 

Besson [1], Kermack and McKendrick 16] and Wallia ar,A iV 4 - f«i 
exact value, although Besson proved it onlv fnr a i Moore [6] gave the 

, wesson proved It only for special casce. R. A. Fisher (31 

gave hm 

n-no E(r) 

It is clear that E(w„j) — E(x. W..* = o 
2F(+'( = 2/(p - 1 ) 1 . We then have ’ P). while E(wp0 « 

("^■2) Eir'p) = 2n ^ ^ _ o P* + P - 1 

(P + 2) 1 (p 4- 2) 1 > 


(P n - 1). 



Rfs'h 11* vsn iK»wji 


SpitiiiK p 1 «*' 

(4,3) A'*rll - Kir) - |(2n ~ I). 

FurrtHik ^4 3- givrn iiy Bi»*nayr»<' (2|. 

\Vp «(«»’ oBtam I4*t u^, ~ EiXpAi Zpi. Thm 

*ii “t r “» *T 

A-4E.vrZ...j 


A >1 ^ j I 2^ 1/ 

(4 4) u'*** J L»*-* Jy 

Z K{t^ + ZZ Kix^ h.) + 1 : 2 : 2„). 

Ktir J > i -f q f 3, arid x^,, arc independent and hence f'iz^^pj) » 0. Omtfc- 
fiiijs wrr» U*rTn»* frntn (4.4) we have 

ffCrpTi^) “ \Z^ K(XfnXf,l d” ^Z Zt B(x^,Zpi) 4* Zj 2j BiX/nX^,) 

% i < I <: % ir f-lt"! »</<»+*P+# 

(4 5) ~ Eix^)E(x^) + E Z Bix^)E{Xf,) 

+ ZZ EMB{x„)]\^ 

t < I*- p + > 

Sinw x,^i,, « ^ , we have for the fimt terrn of the right member 

of (4,5) 

n 

(4,0) Xrf 

r jj jjp 9 ^ jBji 0 

where Uie Kronecker delta 5„ i 

Hinae x^^x^,, » (} for i < J < t -h q, the «t‘cond tenn in the right member of 
(4.5) » 

d” Zj K(x^,Xp,t+^f.i) d" Zj ^,.1+9+1) 

«..{ i-l I"*! 

w }(re - p - ? - 2)£'(-r«i^p.i*-*) 4* (n ~ p - ? ~ 3)£^(x^x,,,^.,^,^) 

^ ^ P ^ q ^ ‘i)E{XtiXp,^^^^i■%) 

d* it>(Xfid* Kix^i d* iS'(Xs[i 

d" BfiX^,n d* y«..t Xp ,n ,.jt) Hh ^ I. 

Now « 2F|—, d-^ ~"'t d-1 ® 2ri,, where 


[•I fVi 


fi r /»vi+» r* 1 

- I ••- jf J dyM‘' 'dUi+t-i 


•dyn-t,' • 'dy, 4 - 1 , 4 .,+i 



62 


H. LEVENE AND J. ■\VOLroWIT* 


The expression rvithin the square brockets is easily evaluated, anri apiilyiiig 

(3.6) to the result, we have 

, ^ 1__ 

(p + 9 + l)p!s! (p + 5 + 2)(p + l)!g! 

____ ^_+ ^ ^ 

(p + 5 -f- 2)p!(g + 1)! (p + q+ 3)(p + UKg h 1)!' 

Similarly, E{x,tXp,,^„+i) - 2P\~, +’, “■ +^ —1, S-Hd /vfx^.Xp.it^+sj w 
2P(-, +'', -, ~1 + 2P{-, +’, +, +1. The other terms 

in the right member of (4.7) are obtained in like manner. The right inetnlMT of 

(4.7) is symmetric in p and q; hence the second and third term.s of the right inera- 
ber of (4.5) are equal. 

We now consider the remaining terms in the right member of (4,«5) for p > q] 
the result obtained also holds for p ^ q> We write them as 


/ n—q n—q 

*“ 'S £(a!gt)£(Xp,v—fp H?)) 

—p + 3 ■•-'p+S 

n—Q 

"1" ‘ * "f" (3;^')£r(Xp,|*.(p_gj) 4* 2 ^ -lO 

(4.8) 

+ • • • + i: E(x„)E(xpi) + "£ /J(x^)7?(x.,mi) 

I**! im1 

The (p + 5 + 5) sums in (4.8) comprise in all ((n - p)(p + 9 + 5) — 2 ^ fcl 

I *»i J 

terms. Remembering that P(xp,n_,) « £(XpO, (4.8) becomes 


(4 9 ) “ Un(p + g + 5) - (p* + pg + g> + 7p + 7g + 16)]/?(i,,)/!;(x,^) 

+ I2p + 4]i!;(x,i)£(Xpi) + [2g + 4]P(x,i)JS(Xp/) + 2£(x,i)A'(x^i)l. 

Adding the right member of (4.6), twice the right member of (4.7), and ( 4 . 9 ), 
we have 


o(TpT^ — 

[ p\v + g'+ 6 )( 9 ' + 3g + 1) 

2n -j _ + p(Zq + 20 g'‘ + 40g + 19) + (g’ + 9g* 4- 29g 4 - 26) 
( (g4'3)l(p4-3)l 


+ 2,- ~ 2 Jr . 7 + i_2__ ^ 

(p + g + 3)(g 4- 2)l(p 4-1)1 (p 4- g 4- 5)(g 4- 3)^?+T)1 
- 2 (P + g)° 4- 9(p 4 - g)" 4- 23(p + g) 4- 14 
(p + g 4- 5)1 


4- 2 


1 

(P 4- g + l)g!p! 


4 - 5„, 


p* 4- 3p 4- 1 
(P + 3)1 



vr WD down 


(i.im 


I 4" 3f/ 4- 1) + p^{ff 4" 9?* 4*193 4- 9) 

„ ' 2 + p'iQ* + 93’’ + 2Hq^ + ^Sq 4- 11) 

^ 2 ^ 

. (q *, ip -r ay. + ^( 3 ^* + 20 q* 4 - -lOq^ 4 - 29g 4 * 10 ) 

1 L + (?‘ 4- 93 ® 4* 273 * 4- 323 4- 10 ) 

fp f 3 4“ 2 )(p - 3 ~ 1 ) ,2 P + 34-4 

fp I 3 1' 31(3 f 2 )!{p + U! ^ (p 4- 3 4*“ 5)'(3 + 3)r(p + I)! 

, 2 +■ + '/J* + 2H(P 4- qf 4* lfi(p 4- 3 ) - 19 

(p 4* 3 4-5)1 


p 4- 3 


p* 4- 3p* ~ p — 4 ! 


(P 4* 3 4-l)3l pi ‘ {p 4*3)1' 


where i« the Kronecker delta. Formula (4,10) is valid for p 4 3 < «■ — 4, 
It i« HjTnmetric in p and 3. fkstUng p “ 3 we obtain 

c\r,) - 2a(~ 2^P'+ 

\ (p4 3)I(p4 3)l 

+ 2 . . 2p* 4 & P 4 12 _^ 4p* 4- 18p* 4 23 ? 4- 7 


. n 2p* 4 &p + 12 

(2p '4 3K2p 4- STIp 4- 3) 1 (p 4-1) 1 
4-2 ^ 

^ (2p+'l)p!pV {p4*3)! J 


{2p + 5)! 


/.I 11\ n. O /o 3p* 4- 24p‘ 4 69p* 4* 90p’ 4- 07p* 4- 42p 4* 10 
(4,11) 4-2j2 *.V3)r(p~4-3)1' 

2pM'_ll/_4- I9pjf 9 _ 

^ (2p-+3)(2p + 5)(p‘+3)r(p"4- 1)1 

, « IBp' 4* 80p’ 4- UOp* 4- 32p - 19 
.. (2p“4-5)l 

4 „ P _ P* 4- 3p* - p “_4\ 

~ ( 2 p+T)plpI ' (p'4-3)"r / 

We next evaluate <r(/pr^), Bince w,i and tOp i ate independent for j > 14 - 3 4 - 2 , 
we have, ootreaponding to (4,5), 

ff(rpr«) «< S ■E'(^jrfW#*)-f X) ^ .^(MeiWw) 4- X) B{WpfW,{) 


(4.12) 


- [E Eiv}pi)E(p^) 4' Xi £ E{v>^)E{v}p,) 

i <<y<i+«+i 

4- ££ E{Wpi)EM. 

«/<«•!»+* 
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Let G = Max {p, q). Then ® Wo; and we have fur the fuel term nf the 
right member of (4.12) 

(4.13) L ^^(Wp.tOp) = E{r„). 

1-1 

The second term in the right member of (4.12) may be written 
{n - p - q - l)E{w,sWf.,+f) + (n - p ~ q ~ 2)/?(u‘,,wV., 

(4.14) 

4- J!i(tCj|U'p.^4i) + 


Now J5(u),arp.,+,) = 2P(-. +’. -"j, E(uvtV..+,M) « 2P!-, -fn + 

2P{—, 4-’’^’, — "j, and the other terras are obtained similarly. The thirtl term 
in the right member of (4,12) will be equal to (4.14) with p and q interehangwL 
The remaining terms in the right member of (4,12) become 


- {[n(p 4- 3 4- 3) - (p^ + pg 4- c’ 4- 4p 4- M -f 
• 15) 

4- [p 4- l]E(w,{)S(u)pi) 4- (g 4- llE(!e,i)4i'(<e;,j) 4- /vr!/’,,)Efirv,li. 

We can now write the formula for <r(/,ri^), valid for p 4- g £ n — 2, 

- o^, / 4- 2) 4- p(2g’ 4- 8g 4- 6 ) + (2g -t- I Uq + 2) 

.(r,r.)-2«|- 


4- 


(4.16) 


(p 4- g 4- i)g!p! 


(g 4^1)(? 4" 2) 4- (p 4* l)(p 2 f 
Ip + g 4- 3)'(g 4- 2) Up 4- 2)1 


— 2 P 4- g 4- 2 (G 4- 1) 1 
(p4-g4-3)!'^ (G4-2)!/ 


4- o / p'(2g 4- 2) + P^(2q^ 4- 8g 4- 5) 4- p(2q’ + 8q ^ + (ig ~ 2) 4- (2g’ 4- 5g’ - 2g - 6) 
\ (g 4" 2) Up 4- 2 )! 


- 2 P 4- g , (p 4- g 4- 2)[(p 4- l) (p 4- 2) 4- (g 4- 0(g 4* 2)] 
(P + g 4- l)g! p! ^ (P 4- g 4- 3T(g + 2) !(p 4- 2)1 

j. o (P + g)' 4- 3(p 4- g) 4- 1 Gf* 4- G - i\ 

(p + g + 3)l . (G4-2)! /’ 

where G = Max (p, g). Setting p = g we obtain 


<r“(4) 


(4.17) 


o„ /_ o (P + l)(2p^ 4- 4p + 1) 

^ (p + 2)i(p + lir- 


4- 2 ^ ~ ■ -- 

( 2 p 4 I l)p'tp! 


- 2-7-_ - _-1 P 4“ 1 . P 4- l\ 

( 2 p 4- 3)(p 4- 2 )Ip! ( 2 p 4 - 3 )I (p+ 2 )'!J 

4 - 2/2 (P + l)^ 3 p^ 4- 4p - 3) _ __p 

\ (P 4-2)Up 4-2)1 (2p 4 -l)p!p! 


4-4 


_ P 4 - 1 _ 

(2p 4- 3)(p 4- 2)!pl 


4 - 9 . • ^P^ 4- 6p 4- 1 _ p* 4 - p ~ l\ 
(2p + 3)1 (p + 2)1 /• 



t‘P ASI> wnvv 


r.5 


Getting p ' ^ 1, wp hsA'p 
M.lHl 


3i, '<1 3, -i Win — 2t> 

ff (r,) -■ fl=(r) - , 


'Hif vahip ftf w&w giv*-!} fiy Bifnayrnt' (2). 

Finally, wr f>valii»U* 

•*'?< 1 53 -rji/) "i" 53 53 hlxpiir^,) 

(4.i«i ■ l53 + 53 £ Kiw„)E(x^,} 

+ 53 53 Eix^,)E{ie„)l 

I>c‘t the’ Jiymhnl >»,, •’ 


(4.20) 


(fl i jj ■ 

53 A’(x^uv) ij^jAXrp)]. 


The iTtjuunijiK UTrnff nf (4.10) intrcKlucc na new diffirultira, anti for j> + q < 
n ~ .1 wo nhtain 

pH'iq + 2) -f p^(2q' + 1.3?+ 12) 

+ p(fK?’ + 22? + 2.3) + (2?’ + (I? + 15) 
(p + 3)l(? + 2)! 


<r(rpr^) 2n 


2 


p- q 


+ 2 


Up + 3 )t(?+"2)1 


ip 4- V + l)rU/l ^ (p + ? + 2)(p + 1)!(? + 1)1 

(p “ ? + l)(? + 2) f (p + 2)(p + 3) + (g + l)(g + 2) 
(p 4* g + 3){p + 2)!(g + 2)1 ■** (p + g + 4)(p + 3)!(g + 2)1 

„«(p 4 g)* + S(p + g) + 5 p’ + 3p + l\ 

(p + g + 4)! (p+3)l / 

p*{2q + 2) + p*(2g* + 13g + 12)' 
r . I + p*( 2 g’ + 13g* + 20 g + 24) 

+ p(3g^ + 22g* + 19g + 27) 

+ (2?* + Og* + lOq + 25) 

- 2 P + g „ P* + ?P “ 9* 

(p + g + l)plgi (p + g + 2 )(p + l)!(g + 1 )! 

_ (P + 2}t(p + 2)(g + 3) »- 1) - 2(g, + ,lK?+^2) 

(p + g + 3)(p + 2)Ug + 2)1 
__ (p + g + 3)I(p + 2)(p + 3) + (g + l)(g + 

(p + ? + 4)(p + 3) Kg + 2)1 

, 9 (p + g)® + 0(p + g)’ + 8 {p + g) “ 1 __ p’ + 3p* - P " 

+ -"'--^^ 4 . 4 ), - n,, (p + 3)i *7» 

where ?p, is defined as in (4.20). 
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6. The use of runs up and down in. tests of signiftcimce. (mirtinn- 
ceptvous ahout the application of runs up and down have iipfK'arfrl in flit* litera¬ 
ture, and it is the purpose of this section to clarify them. 

Since Sir,,), (r^), E(f) and ir^r) are all of the order n, it follow ,h that r^/r 

converges stochastically to 


Hm 


m 


Let 


X',. = lim -if/} . 


From (4.1) and (4.2) we have 


Xi = I = .6250 

X» = ^ = .2750 
40 

X. - «, = .07917 
X. - jIo . .01720 
x; = i - .00357 


Let 


X - 

F(r) ■ 

Some writers say that X^„ or Xp is “the probability of a nm of length j>." If 
the stochastic process consists in obtaining a sequence from among the n! se¬ 
quences S, each of which has the probability (n!)“‘, then the phrase “the prob- 
abihty of a run of length p” lias no meaning. One can speak of the probability 
of at least one run of length p (i.e., that r, > 0), of the probability of no nm of 
length p (rp = 0), of the probability that the first or fifth run (if there are five 
runs) in the sequence S be of length p, etc. It is possible, to give diffexenl sto¬ 
chastic processes in which “the probability of a run of length p" will have 
meaning and be X„„ , or X^ , Consider, for example, the totality of all the nma 
in the n! sequences S, Tliei’o are n\E{r) of them, and among these there arc 
n\E{rf) runs of length p. Now let the stochastic process consist in drawing a 
nm from the totality of all these runs, each of which is to have tlio, same prob- 
abiUty, which is therefore [7i®(r)]“* Then the probability of drawing a run of 
length p ia Xpn. It is difficult to see how this stochastic proccaa can have role- 



KfSfk n* ANt> DOWN* 


()7 


v@httct‘ tut niiwt nf tltf* pf*iltkTtwi t»f tjuality rtmtrfil fOid t'ciinomk; lime wirira where 
rtiOK up (lUfJ rirmn ane new uptpd, 

Sr*fne wntere *m <|ualit.v rtmtnil and emnumie time Kerie« recommend that 
ji(tat»firAl e'rnirtd nf raudumnew Ih‘ tester} by use t)f di, • ■ ■ , dp^i , dfp , where 

d, r, - E(n), (t ^ 1, 2, > • • , (p - D), 

dp * r; - K(r'p). 

The availability »4 the envanaiiee matrix 3/ of rfi, * • • , i , dp , which we have 
obtamwl in tlus }«per, wilt wwt m Uie constnictiun of such teatH. Also of help 
will Iw* s nwiU repicntly mmmmml by one of u« j7), the early puldicatbn of which 
is exfieeted, 'Hns rmdi states that in the limit with n the joint probability 
density funetum of dj , dp, is Kc where K is a constant and Q 

is a tjuadndie bum in dj, • ■ ■ , dp i. i/p whose matrix is the inverse of the matrix 
ylf. It fulhms immerlmteiv that Q lias in the limit the x* distribution witli p 
degne^w of fitt'ilom. 

We wish n»w to make a few remarks about the. tests of KiKnificance, based on 
runs up and down, which are used by some contemporary writers. A descrip¬ 
tion of their method eon perhaps lie Ixwt (pvan by an example. With n =» 100 
and p .1, «»>', siipfaw the. ulwervetl values are: 

Obsemd Vedues 
Ti « 30 

r, w 10 

7*1 ns 4 

r4 “ 3 

rj BH 3 

Total,T® 'so' 

ntene wrilerti then say tlmt the exiiccted values arc: 

Kxptclfd Values acctrrding to some tvrUers 
A"(r,) = rX, » 50 (.6250) »= 31.26 

AXrj) * rb « 50 (.2750) »= 13.76 

E{ti) « rh “ 50 (.07917) = 3.96 

K(r4) « rX4 “ 60 (.01726) - 0.80 

/^{rt) « r\i 50 (.00357) - 0.18 

50.00 

The correct expoftleil values are given by (4.1) and (4.2) and are: 

Correct KxpecM Values 
E(ri) «* 41.76 
A’(r«) “ 18.10 
A’(ri) w 5.15 
« 1,11 
“ J:22 
66.33 
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It should be noted that: 

(a) A consequence of the incorrect method of obtaining 'Vspwteil values” 
is that, since 

E{t) = FM) + Ein) + EiXi) + E{u) + Rirl), 

it implies that the expected number of runs of all lengths is ecjual to the obnenxd 
number! This is obviously erroneous. In fact it follows from (4.18) and the 
results announced in [7] that r ~ E(f) ia in the probability sense of order %/n. 

(b) By using the incorrect expected values for comporiaon with tlie otwerved 
values one loses the valuable information furnished by r — I?(r). If thi« i« large 
(lu terms of its standard deviation) it is plausible to eiuestion whether etetistic'Al 
control or randomness exists. 

6. Summary. Let S = Qh, • ■ • , lu) be a random f>crmutatmn of the n 
unequal numbers m, ■ • • , Ort, and let Ti! be the sequence of signs (+ or —) 
of the differences /i,+i — /q (i = 1, • • • , n -■ 1). It ia assumed that each of tlm 
n! sequences S is equally probable. A sequence of p succesaive -)• (■”) signs 
not immediately preceded or followed by a + (—) sign is called a run up (down) 
of length p. Let r, and r, be the number of runs up and down in K of lengtha p 
and p or more respectively. In this paper the exact values of (»ee 

formula (4.10)); <r’(r,), (formula (4.11)); v(rpr'), (formula (4.10)); (for¬ 

mula (4.17)); and v(rpri), (formula (4.21)) are derived. A few numerical 
values are; 



305n - 347 
720 ’ 


<r*(r») 


5110671 - nm 

4^600 


2, ^ lOn — 29 i, 1, 

° = —90— ’ 

67n - 43 

720 ' 

(r*(rj) 

2149071 - 51260 
463600 

, . 1971-1-11 

210 ' 

/ ^ f\ “ 3 

tr(rjri) w 

41n - 99 , ,, 

630 ’ 

23n +136 

1260 ’ 

xinri) 

11771 - 70 

as — ^ , 

720 

. /, 36371 - 817 

6040 ■ 

and <r(r*rj) 

1834671 - 49019 

mm 


The values of S(r,), (formula (4.1)); and A’(4), (formula (4.2)) are also 
given. Certain misconception.s about the applications of runs up and down 
are discussed. 


REFERENCES 

[1] L. Bssron, (tranal. and abr. by E. W. Woolard), "On the comparison of metoorologieal 
data with chance results,’’ Monthly Weather Review, (U, S. Weather Bureau) 
Vol. 48 (1920), pp. 89-94. 

[21 J. BiENAYMt:, "Sur une question de probabiliWs,’' Bull, Soc. Math. France, Vol. 2 (1874) 

pp. 16.8-164. V 



St *tS I P turns 


m 

W R A FirbT'S, 'Hu i'S*- T.’sniHm jtrsjHfirir*’,'' QunrSMy Jnur, Ran MHmmlitgical iSV. 

v»’] w >vmi. p v*t 

<45 W CJ K»>»«4'|8 n’sff a *» Kii'irtRHR.'IfKM for ran'irimnwi ui inwricsof obwrva- 
' I'lTii*' fcv AV Fdi'-Aurgh, Vol ,'»7 flP.'fT't, pp 22Jv''i4(), 

W H A ** Alit K!!'»pS.!*'k. "Attiw (liRtnhutintm wwwinlerl with ji rati- 

s{oJ>ih wraBi'*"! »<! h'lmWa/' /’r<K ffaj/ .S*w Rdmhurgh, Vol. fi? (t!>37), pii. 

M2 a:** 

[fij W A WninaA-xpH H M««»rr, ^ f«4t/wr fimp nrrirt, Technifat Paijer 1, 

?<n< IHirpa’f ot Him , Sew York, llMl 

17 | J Wnwowitt ' ^EynipInSif 4i*tnlntStori*(»( iMirpmtinR apd ifpecpStltUR runn," fafwlracl) 
4»«rr ' . Vof ««4 JIW), pp. m 540. 



ON THE MEASURE OF A RANDOM SET 
By H. E. Robbins 

Post Graduate School, U. S. ISfcwal Academy 

1. Introduction. The following is fjerhaps the Himjilwt nrm-trivml example 
of the type of problem to be considered in this paper, On the real numlMT axis 
let N points Xi (i == I, 2, • • * , N) lie choeen independently and by the aame 
random process, so that the probability that X{ shall lie to the left of any point 
a: is a given function of X, 

(1) <r(x) = Pr (Xi < x). 

With the points %, as centers, N unit intervaln are drawn. I^et X denote the 
set-theoretical sum of the N intervals, and let y{X) denote the linear meaaure 
of X. Then n{X) will be a chance variable whose values may range from 1 
to N, and whose probability distribution is completely dcte.nnined by ff(x). 
Let t(u) denote the probability that fi(,X) be less than u. Then by definition, 
the expected value of ii{X) is 


(2) 

E(m(X)) - j\driu), 

where 

(3) 

t(u) =■ Pr (m(X) < li). 


The problem is to transform the expression for EOi(X)) bo that its value may l>e 
computed in terms of the given function a(a:). 

In order to do this, we observe that, since the are independent, 

(4) r(u) = I • • • J dff{xi) * • • d(r{XH), 

o(«) 

where the domain of integration C(u) consists of all points (xi, * ■ • , x#) in 
Euclidean JV-dimensional space such that the linear measure of the set-toeoretical 
sum of N unit mtervals with centers at the points xt is less than «. Here, how¬ 
ever, a difficulty arises. Due to the possible overlapping of Uie htttorvate, the 
geometrical description of the domain C{u) is such as to make the expUcit evolua^ 
tion of the integral (4) a complicated matter. 

The difficulty is even more serious in the analogous problem where instead of 
N unit intervals on the line we have N unit circles in the plane, with ft given 
probability distribution for their centers (x,, y,). Again we seek the expected 
value of the measure of the set-theoretical sum of the N circle. The conwpond- 
ing domain C{u) in 2A/’-<iimenBional space will now be very complicated. 

It is the object of this paper to show how, in such cases as these, the expected 
value of niX) may be found without first finding the distribution function 

70 
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In farf, t1»< f<. I-*t' i»»aM iit fl5j will in nifiny impnrtftrit yirld a 

rnin{«ariitn*‘S\ f*rnsi'ila f<.j KiufXti 


%. Expecl&d Tiihw of w'-.V . In f«.rdtT lo the prohlfm in full genorality, 
Ift 11 * 11**1 X SI random I^-lw^^gjip mfwurahln wulwt of Kuclidean n 

diinmwtuns! ?}»«*• fX Hv thi** mr nlmll inran that in tlir apacn 7' of all pirwible 
\«lu» of -Y <h«'r>' i« 4r’ho»^«i a |>r»4«lHlily nmaairn' p(A') an that for fvery p- 
mwurahh* *.u} «'l S <ii T, lh»' pr<il>«hihtv that A' ahall hclniig to iS' in given by 
thr Uit^'Kral 

fSI iV tA^.V) = f fVfA'ItfpfX), 

jf 

when* tbo !r»*i‘t«Tanfl w the ^-haraf-tf-fintir function of 

1 for A't K 

(03 , 

sfi r„r X < A'. 


In prai’fiff*. tbr* X iajH I<f a funrtion of a finib' numlH>r of real parameters 
fc.g, Ibr ntM'ntbnatrf. >*1 thi* center* of the inlervala or circlcK considered in the 
Introduction b .V • Abo,, -■ A'tn). There will Is? given a probability 

measure rfen tn the jwameter simee K ,. m llml n will be a vector random 
variable m the <irthnHry If A ia any ^-measurable subset of Er, then by 

definition, 

f7) CJa)M<x)- 

•fx. 


Now for Ute f*el A' namtHting of all X aueh that A’ « X(a) for a in A, we define 
p{S') ^ I, 'now a. #>-meaaur'e is defirted in the apaee. T of X, which ia the 
general situation crmsideml in tin* preewling fiaragraph. 

Reluming to the general ram* dtwrilwd in tlie first paragraph of this section, 
we ahall nttw prove the main Iheoinpra of this paper. To this end we define, for 
every ptrfnl x of A'« and every wt X of T, the function 


( 8 ) 


ff{x. X) 


I for X € X 
0 for X < A'. 


Moreover, for every x in /;.« we let Nfxi denote the set of all X in T which contain 
X. 'Uten for every x in i?« we have from (6), 

( 0 ) X) ^ VmniX). 

I,et iw dimote tlj^* Ijel»»gun me«ure in Ka of the act X by a(X). Assuming 
that the fimelhm g{x, X) i a gg^rneasurable function of the pair (x, X) in the 
protiuet *pa«»‘ of A', with T, it follows from Fubini's theorem' that 

(10) f fCx, X) dw(x, X) « f [ gix>X}dp(X)dp{x). 

‘Bee S. Saks, Tkmrj/ pf ifw /atesnal, CJ. E. Slechort, N. Y., 1937, pp. 86 , 87. 
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From (6) and (9) it follows that 

(11) f g(x, X)dp(X] = Pr (Xt.Six)} - Pr (je.Y). 

J 

Again by Fubini’s theorem we have 

(12) f g(x, X) dtip(x, X) ^ f f g(x, X) dftix) dp(X} 

JjfnXr 

But from (8), 

(13) f ff(x, X) dn(.c) = [ dii{x) « n(X), 

Jj!. JJT 

Now from (10), (11), (12), and (13) w’e have 

(14) f Pr (x« X) dM®) « f p(X)dp(X). 

•'T 

But the latter integral ia equal to E(fi(X)), Hence we have the retatiou 

(15) E{p{X)) ^ f Pr(»tX)dM(x). 

This ia our fundamental result, We may state it as a 
Theorem: Lei X he a random Lebesgue mexmtrabk mheet of bX , mlh mmmre 
p{X). For any point x of lei p{x) = Pr (x eX), Then, anmming ihal the 
function g{x, X) defined'by (8) is a measurable function of the pair (j, X), the ex¬ 
pected value of the measure of X will be given by the Lebesgue integral of ihefunelion 
p(x) over En . 

3. Higher moments of ^(X). We may generalize the rt'sult (15) to obtain 
similar expressions for the higher moments of m(X), For the second moment 
we have the expression 

(16) F(a“(X)) = f a’(X)dp(X). 

Jr 

Now from (13), 



niX) = 

/i(X)'a(X) = f g(x, 

, X) du{x) * f giy, X) duty) 

(17) 


t* y* 




= / / 

ff(*> X)'Cf(5/, X) di*(x) dpCy). 

Let 




(18) 

(/(x, y, X) 

= y(x, X)-g{y, X) “ 

1 if X contains both x and y 
0 othewisc. 
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Thfii from aO!, (171, and U8), wp have as before by Fubini’s theorem, 

^ [ f f g ( x , y , X ) dn ( x ) d ^ iy ) dpiX ) 

■'r JUg 

I I I v>^) dfiiv). 


rial 


But from C5| and (18) it follows that 


t20) 


j S ( x , j /, -t) dp(X) = Pr (x t X and y e Jf). 


The latter probahUity may t>o denoted by p(x, y ). This function will be defined 
over the fartwian product, i?j,, of with itself. I^t p (. r , y ) denote Ix-besRue 
rnpftRure in Ku . Then from (19) we have 


(21) Eip^X)) » f p(x, y) dfi{x, y), 
where 

(22) pix, y) » Pr (xeJf and yeX). 

The formula for the mth moment of m(X) will clearly be 

(23) Ex|) (m^C-V)) * f p(-ti,Ti, ,x„)dti(xi,xt, • • ■ , x„), 

’'If... 

where r(xi , xs , ■ • • , x«) denotes Ix’lx’sgue measure in and where 

(24) p(xi, »i, • ■ • , x«) «* Pr (X| ( X and Xi eX ■ • • and e X). 

In the next section we shall apply formulas (16) and (21) to a specific problem. 


4. Let a, p, li 1h' given positive numlwis such that (/) + a)p < a and a < B, 
We shall define the random linear point set X os follows. N intervals, each of 
lengtli a, are chosen independently on the number axis. The probability 
density function for the center of the ith interval will be assumed to be constant 
and equal to p/a in the interval —a/2 ^ x < B + (o/2)j it may be arbitrary 
outside this inietn'al. The set X is now defined as the intersection of the fixed 
interval It 0 ^ x B with the variable set-theoretical sum of the N intervals. 
The hypothwis of 05) i» clearly satisfied. The probability that any point x 
in the interval I ahall l>e contained in tlic tth interval of length a is clearly 
(p/a)a w p. From this it follows that 


1 


(26) Pr (x eX ) p ( x ) «“ 

From (16) it follows that 

(26) E ( m ( X )) « p ( x ) 


- (1 - p)" for 0 < X < B 
elsewhere. 

dx - B (1 - (1 - p )"). 
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(The same formula holds in. the case where the intervals of length a are re¬ 
placed by N circles of area a and I by a plane domain of are.& B, providerl that 
for every point of the domain the probability of Iwing contained in the fth circle 
is equal to a constant p. A similar remark holds for spheres in space.) 

To evaluate E(j/{X)) in the. linear case we make use of the identity 

(27) Pr {A and B) = Pr (,l) -h Pr (B) + Pr (neither .4 nor B) — 1, 

which holds for any two events A and B. It follows from (27j and (2S1 that if 

X and y are any two points of /, then 

P(.^y y) = Pr (* i AT and y t X) 

(28) = Pr (a: * a:) + Pr (y < X) + Pr {x tXmdyiX) - I 

= 1 - 2(1 - pf -1- Pr (* < X and y i X). 

Let 

(29) h{x, y) = Ft (x 4 X and y iX). 

Then 

[1 - {v/a)2af = (1 - 2pY, for 1 y - x I > n 

(30) h{x, y) = ■ [1 - (p/a)(a + \y ~ il)]'' « (^- pll/ ~ 

for 1 1/ -* X! < 0, 

Now from (21), (28), and (29) wo have 

= f f p(x,y)dydx 
Jo Jo 

[1 — 2(1 — p)" -f hix, y)l dydx 

= B’[l ~ 2(1 — p)"] + 2 f / A(i, y) dydx, 

JQ J, 

When the latter integral is evaluated the result is 

E(AX)) = B^l - 2(1 - p)^J + (B- «)>(! ^ 2py 

(32) 4 - 2aB(l - p)"-^ ' __ 2o(B - a)(l - 2p)"*' 

+ l)p ' ^ W‘+"l)p 

2a» 

- (X + im + 2)p^^(^ - p)""* ~ (1 “ ap)""'!. 
Combining this with (26), we find for the variance of y(X) the expreaaion 
v” = E(n\X)) - lE(n(X))r 

(33) = (B - a)*(l - 2p)'^ _ B*{1 - v?" + ~ p)""'' 

(W d- l)p 

_2a(B-a)(l-2p)''+‘ 2o’ 

(T+WT^ - (1 ~ 2p)''+*). 



ON THE DISTRIBUTION OF THE RADIAL STANDARD DEVIATION 


By Frank E, Grubbs' 

Aberdeen Proving Ground 

1. Introduction. Of interest in the field of hallisticfl is a ineMure of the 
accuracy of ImlJeta. In acceptance toata of small arms ammunition lots, for 
example, a sample of rounds from each lot ia fired from a fixed rifle at a vertical 
target placed a Rpeeified distance from the rifle. The accuracy of the bullets 
i.s taken to he some measure of the scattering (or lack of scattering) of the bullet 
holes on the target. The purpose of such a test would be to determine whether 
or not the lot under consideration differs significantly in accuracy from (a) 
standard values or (Ij) its predecessors. 

One UiSeful measure of accuracy is the radial standard deviation which is 
defined by the relation 

( 1 ) ^ ~ > 

where j, and y, arc respectively the abseksa and ordinate, of any point measurerl 
from an arbitrary origin anti is the sample siiw'. 

It will be the piirposc of the present discussion to call attention to a serie.s 
expansion for the distribution of the statistie Z in samples of ;V assuming that 
the distribution of all rounds of tlie lot on the target follow the hl\'ariate normal 
population law 

1 

(2) /(JJ, f) ® n fx and 1 /statistically independent) 

2jr<Tj ffj 

where <rj and a| are the parent variances of x and y re8pectivel\’. In the above 
probability density function, the population means are taken to be zero .since 
the statistic Z m quite independent of the origin selected. 

2, Moment generating function of Z\ The distribution of s? = ^ 2(X( — S)’' 
in samples of JV from a normal population is given by the well-known law, 



The moment generating function of s? may he found (in a neighborhood of 
I «■ 0) by straightforward integration: 


(4) M,i(0 • £’(e*J') - I" e'J'dFCsf) 


WJ 


‘ Captain, Ordnance Department, Ballistio Research Laboratory, Aberdeen Proving 
Ground, Md. 
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Likewise, for ~ ^ “ y)\ we have 


( 6 ) 




{' - fy 


UK-n 


Now MztW = Af.?+.?(0 = « E(e‘f‘)-Eie‘i‘) since t md u wn in¬ 

dependent. Thus, 




V ; V 

- 


3. Distribution function of 2*. Making use of the Fourier theorem, we have 


( 6 ) 


»-i£ 


-U.v- n 




at all points of continuity of 

The discussion will be divided preferably into the two casea: Cm' I: at »», 
and Case II; ai ^ al, 

Case I: af =‘ at = <r*. 

In this case the distribution of 2* reduces to 

It uill simplify the algebra to find first the distribution of i<* « 


that of 2^ Since — (1 — t| 


-tw-i) 


.V2* 


and then 


( 8 ) 


f(u^) = 


This integral may be evaluated easily by the calculus of residues since the inte¬ 
grand has only a single pole of order (N - 1) at t -* -f. We will, however, 
make use of the following method. 

Put — u = u* — iu’t; then 

27r Lui-im, \ uy tti* 

2irt 


(9) 


I dv. 


The integral in the last expression is Hankel's integral [1]; namely, 


( 10 ) 


-a+(«o 


TiZ)~LL+i„ ® 


/(u=) = 


RiZ) > 0, 


a > 0. 


rovT^) • 


Therefore 
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and 


(U) 


dF(?/) 


2(r2 

r(^-1) 



from which 


dF(2) 


/nv~' 
2 1 “) 

'r{N -"ij 




dZ. 


(Note that/(Z) ia ccuttUnuoufl over 0 < Z < «.) 

Tliis expected mult haa been obtained by Reno and Mowehowitz [2] who 
employed an extension of the famous Helmert distribution. 

Actually, the result is an obvious one and may be argued os follows: Nal/cr^ 
is distributed as x* with K — I degrees of freedom and Nsl/c^ is also distributed 

08 X* with N — 1 degrees of freedom. Hence, the statistic ^ (a? + s\) is, from 

the additive property of x*. distributed like x* with 2M — 2 degrees of freedom. 

We now turn to the general 
C(m //:»*}** 

No generality will l>e lost by taking aj < . In fact, the present attack will 

hold with obvious mcxlifications provided a\ < 2(ri. 

Recall tbot 


(12) /(!?*) 


1 r 

2?r A** 


1 


2a] it 
N 


Mn-K 


1 “ 


2a\it 

"N 


■Us~n 


c-’**' d<. 


at all continuity points of /(/?“). 

In a manner analogous to that employed by Hsu [3], we replace 


O-l") 


. 1 

1 - 2aUt/'N. 


Further, since 

J 

I - 2alU/N 


we may write 




78 


fKANK K. QRfBBS 


Tims, 


/ 

(13) /(2=) = 


2y(A-i) 

2ir 


/>«> <o 

I ^ 

J—s® r»0 


(-rl)' 


{■ 


-V I 






with the imderetanding that ri9 




« 1 for f » 0. 


We note that the moduli of the terms of the above series are for all I tuil greater 
than the corresponding terms of the following convergent aeriw of tK^itive terms; 

t (‘-rP’ 

Therefore, uniform convergence over (~“=, “o) is ostablishetl, To shtnv tlmt 
we may integrate over the infinite interval term by term, we nbm*rve that 

1 5(0 — 5,(0 1 < <y>(0 for all I and all large r, where 


S{1) 


1 - 


2a] U 

N 


-M-i) 




S,{t) = the sum of the first r + 1 terras of the series, and the function y>tO 
2c^it 

which ia integrable over (—<», w). That is, 5,(0 c<»nverge« to 


1 - 


5(0 uniformly relative to v!'(0. Hence, 

2\UW-1) / _i\f 


(A) 

(14) /(ZO = W 


2Tr 


r-0 


(lilL 


We have already carried out the integration under Case I with the ejteeption 
that {N - 1) should now be replaced by (W + r - 1). The distribution of Z* 
will then be given by 


dF 


(15) 


viy Ff 

- AiV"'- V y-W S! 

^ ^ VJ ■-TV-\) 


r/3 i 




‘ \2a 


]) 


tf-i 




• The author is indebted to Prof E. J. MoShano lor this definition which)» due to Prof. 

5,(0 di « r lira 5,(t) dl. 

« X-«i r->» 
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Finally, tli& dintribution function of 2, is 


(ifi) mz) 


© 


(1 


s: 


(l _ £lY 

\ fl) \2(r?/ 

^.v-,^^)r(.V+V 


N'tr-l 


ly 


NX* 

'sTi ^S«l5r-J 


dz. 


We remark that the above scries expansion holds, of course, for N odd or even. 
In CMC N is odd it may be Bhown that the distribution function may be expressed 
M a finite BCriw of Incomplete Gamma Functions,’ However, the finite expan¬ 
sion for N odd appears to offer no marked advantage since for computational 
purpoeea the infinite ecries expansion converges quite rapidly {N either otid or 
even) and may be put into a convenient form given below. 


4. Computational form for the distribution function. In deciding whether 
or not an oliaerved value of Z is significant and likewise in control chart proce¬ 
dure, one ia interested in tlic percentage points of f{Z). For example, it may be 
d«ired to find the value of k such that P{Z < /cy/vr+yj) = •QflSj 
various sample aim N. In this connection it will bo convenient to work with 
tlic distribution of Z^, for P{2 < 1:%/'?!'+ irji = ^ + o'?)) a-lso- 

Now, 

,*»(*>+»■) 


< ifcV* + 4)1 » / dF{Z^) 


(18) 


© 




r/9 


(‘-^y. (© 

ry;y ' 


r(// + r 

*>(•{ t-.») 


1 ) 




since we may integrate the scries term by term over the entire range of Z^ or 
any part of it [5J. In the terminology of Karl Pearson’s Incomplete Gamma 
Function (31, 

j\/ yH 


( 10 ) 


I(u, p) 


r(p + 1) Jo 


r 

Jo 


'vUv, 


wo may write the above sories in the form 

P(^ 5 W + »i)l 


( 20 ) 


f' ^ i ‘*■ 4 ) 

V<^l/ ^ , r) I^VFT r -1 ’ 


W + r- 2 


' Prof. C. C. Craig kindly pointed out this fact to the author. 



so 
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It is indeed convenient and enliRhtening: that the tewult i« si funrlinn nf the 
ratio, al/al, and not a\ and/or <rs explicitly. 

Hence, for a given sample size an d ra tio of o-J/e-l, we may find k by inverse 
interpolation suchthatF{2 < feVerJ + <r|l » «,any desired level of probability. 


6 . Moments and percentage points for Case I. For the ra«‘ met many tirach 
in practice, i.e, irj «= cr® » tr®, we will give a table of the mean and atandtud devia¬ 
tion and also several probability levels which are obtainable directly from the 
percentage points of the. x distribution (fi). 

From (11), we have 


( 21 ) 


EiZ'-) 


NS* 

e“^ 

r(N - 1 + k/ 2 ) 
r(jv - 1) \N/ " 



Thus, 

( 22 ) 


Mil* « 


r{N ~ 1 / 2 ) 

HN - 1) 





(23) 
and 

(24) 


/ 


m ~ 1) » 

_—a, 




{at-.-P 



In the table below, the mean and standard deviation are given os a multiple 
of Y2<r and k.n , for example, is that value of k such that P\Z S k\/2if\ » .95. 


TABLE I 


N 

Mean 

Standard 

Deviation 


Percentft 

few 

ge Points 

Ktt* 

2 

.6267 

.3276 

.0601 

.1602 

1.2239 

1,6276 

3 

.7676 

.2780 

.1857 

.3442 

1.2676 

1,6738 

4 

.8308 

.2443 

.2906 

.4621 

1.2546 

1.5220 

5 

.8670 

.2198 

.3067 

.5227 

1.2463 

1.4817 

0 

.8904 

.2014 

.4239 

.6730 

1.2361 

1.4488 

7 

.9068 

.1860 

.4680 

.6110 

1.2286 

1.4218 

8 

.9189 

.1762 

.8046 

.6408 

1.2167 

1.3991 

9 

.9282 

.1653 

.6346 

.0661 

1.2087 

1.3708 

10 

.9366 

,1569 

.6697 

.6862 

1.2014 

1.3830 

tl 

.9416 

.1498 

.6813 

.7023 

1.1949 

1.3483 

12 

.9466 

.1434 

,6001 

.7170 

1.1889 

1.3363 

13 

.9608 

.1378 

.6166 

.7298 

1.1836 

1.3237 

14 

.9644 

.1330 

.6313 

.7411 

1.1784 

1.3132 

15 

.9675 

.1285 

,0445 

.7612 

1,1738 

1.3038 
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A MATRIX PRESENTATION OE LEAST SQUARES AND CORRE¬ 
LATION THEORY WITH MATRIX JUSTIEICATIOH OF 
IMPROVED METHODS OF SOLUTION 

Ry Paul S. Dwyeh 
Unimdly of Michigan 

1. Introduction and summary. It ia tho aim of thw paix-r to j'xliiltif, liy oaitiK 
elementary matrix theory, tlie basic conceptH of least squanw and t-orndtititm 
theory, the solution of the normal equfttionR, and the pr«5(,‘,ntatic3n and justifit'a- 
tion of recently developed and newly proposed leehnitiues int<j a wngle, cam- 
pact, and short presentation. We shall be mainly concerned with the following 
topics; 

a. Basic least squares theory including derivalitm of nonnal equatirms, the 
theoretical solution of these equations (regression ctK'fFicientK), the standarri 
errors of these solutions, and the standard error of pstimaLe. 

b. The more specific theory (correlation theory) resulting from applying the 
general least squares results to the standardized distrihulions. 

c. A matrix presentation of the Doolittle solution. 

d. A simple matrix justification of methods, pteviously prewmU'rl, for getting 
least squares and multiple correlation constanta from the entriw of an abbre¬ 
viated Doolittle solution. 

e. A presentation of a more general theory which the matrix pmientallon 
reveals. 

f. The outline of a “square root” method an an alternative to thpDooUttle 
method. 

The reader should be familiar with elementary matrix theory such tw that out* 
lined on pages 1-67 of Aitken’s book [1]. 

No previous knowledge of the Doolittle technique is demanded aiUiough a 
familiarity with the notation and contents of two earlier papers |2], [3] is ativised, 
particularly for those who are interested in the computational aspects. 

The presentation here is theoretical and is not concerned with such compu¬ 
tational topics as the number of decimal places required, etc. With reference 
to the number of places, the reader is referred to the recent paper of Professor 
Hotelling [4]. 

2. Notation. Let [z'ij with 1 < t < AT and 1 j < n be the n by TV matrix 
of observed variates of n “predicting variables" for N individuals with i indicat¬ 
ing the individual and j the variable. Let [y'i] be the one by JV column matrix 
of the observed variates of the “predicted" variable. Let the matricM of devia¬ 
tions from the variable means be indicated by [zjy] * X and «« Y. Then by 
the least squares hypothesis we are to find numbers h ^,.., , ■ • • , 

such that 

e,' = j/.' — (Ziibrt.... -p ajftbys..., + 
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Khiill havp. a ramimum variation (ntandard deviation). We then denote the 
bg,. hy the one by n column matrix B and the Cf by the one by N column ma¬ 
trix E and have 

(1) E^Y ~ XB, 

as the baftic matrix «]uation. 

It may be notwl further that the fitted valuea of y, arc given by the one by M 
matrix prcKiuet XH = Y, Um'ng thia notation (1) appears as 

(!') E ^ Y ~Y. 


3. Basic least squares theory. 

a. Bum of sptm-ei! of reMuals. The condition for minimum variation in this 
situation (variates measured from means) is equivalent to the condition for 
minimum sum of squares of residuals. In matrix notation this sura of the 
squares of the mdduals con be written 


(2) E'E with E ^ Y — XB = Y — Y, and E' the transpose of E. 

h, Thf nmnal equalions. Differentiating (2) with respect to B' we find the 
ntHfOSBary condition to be 

(3) X'E » 0. 

ITiia matrix cciuation gives the normal equations in implicit form. More ex¬ 
plicitly by (1) we have - ZB) » 0 so 

(4) X'XB - X>Y. 

The reader should immediately rect^ize that (4),is the matrix equivalent of 
the usual statement of the normal equations where deviations from the means 
are used. It should be noted also that (3) and (4) can be written in the form 

(5) X'Y “ Z'T from whence at onoe Y'Y Y'Y. 

c. Solution of normal equalxono. The theoretical solution of (4) is accom¬ 
plished at once and resulta in 

(6) B » {X'Xr'X'Y - (X'Xr'X'Y. 

d, SUmdard dwialion of residuola. The standard deviation of residuals is 


vwm- 


In order to evaluate this we note that 

(7) Y'E - B'X'E « 0, and TT - JT, 


Thus 

(8) B'E - (F - T)'E * TB « T{Y - XB) - Y'Y - Y'XB, 
and 

(9) Y'XB - Y'Y “ Y'Y » TY. 
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Since Y'Y « £{/^ v/c have 



so that, dividing by N and taking the sriuare rotJt 


(11) S, =» 8, y I - - . 

If the relation between the estimated atandard deviations in the {Kjpulatiori i« 
desired then divide each side of (10) by the number of degrwa of fttxidom and get 

Alternative formulas to (11) and (12) are obtained by replacing Y'XB by its 
equivalent expressions In (9). 

e Formulas for muUiple correUUion ccefficietU. It is to iKt that the 

numerical quantity Y'XB/iy^ plays an important role in measuring the ratio 
a^/try , It is customary to use this quantity as the definition of the wjuare of 
the multiple correlation coefficient so we have 


(13) 


*r Tiv 


Y'XB 
■ 2/y^ 


B2['XB 


f. Formulas for correlation coefficient. 
X'Y = SX7, B = h and (13) gives 


Y'XiX'Xy'X'Y Y'Y 4 

EESt > BS; Kytr . 

When rt *= 1. X'X - Sx\ Y'X « 


(14) 


T'va — 



^/2x* 


Many of the above developments can be duplicated, without formal use of ma¬ 
trix theory, by judicious use of symbolism and substitution. See for example 
the presentations of Kirkham [6], Bacon [0], and Guttraan (7], 
g. Errors of regression coeffiaenls. If Bo is an approximation to B such that 
Bo -j- AB = B then (6) can be written 


Bo + AB = {X'Xr^X'Y 
and 


(15) AB = (X'Xy^X'iY - XBo). 

This formula can be used in finding corrections AB necessary to change any 
proposed trial solution, Bo , into a correct solution. It could also be used in 
extending the accuracy of a solution after an approximation had been secured 
to a specific number of places. It has greater utility however in another problem. 
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Wp Kuppcw that the predietin« variaWefl, the x’h, contain no cri'ore but that 
there are errtin* in the o1>M'rvHl vahies of y. Ixit the hypothetical ob.wrvpd 
vahitm of y he indicated by }’ and the recorded obaerved"^ vahiea of y by l^o. 
Ix't the valnf# of ft 1 »p the rpgrpH»i<in coefficients obtained by using the recorded 
ol»erv«I raluwi }’« . Thus Aft 0 when V is replaced liy }"o in (15). Now- 
let r — ATft, the “true" residual errors of the. recortled (jb,served values, be 
indicate! by E. 'Hien (15) becornra 

(10) Aii » (X'Xy^X'E. 

Bntopling theory can be applied to ( 10 ) to obtain a formula for the standard 
error of the regression coefficient. It is a^umed that the “true” residual errors 
art? indefjendent -witb a common standard deviation tr.. The values of AB arc 
then linear funetions of thc«r errors. It follows that 

(17) al ^ ffl„ = (X'xy''rxix*x)~V, = (rx)-‘<r’. 

The standanl errors of the n»grpasion coefficients are thus formed by multi¬ 
plying et by the square roots of the diagonal terms of the inverse, of X'X. 


4. Standard variates. Use of correlation matrix. Many of the formulas of 
flection 3 are slmplificrl witli the use of some type of standardization. In par¬ 
ticular it is poflflible to redure the matrix X'X to the matrix li of correlation 
coeffide.nta by replacing x by h/X where (* « x/a. If y is similarly replaced 
and B by B, then .Y'l' “ /f,, and V'X =» , V'V = Sy‘ — 1 and selected 

formulas from flection 3 become 


(18) 

<19) 

( 20 ) 


BB •» 

B - B~‘B^ 

» B^B - B'RB =» R',,R-^B^ . 


Classical multiple correlation formulas, determinantal and othcrw'ise, are 
"covered” by the matrix formulas ( 20 ). 


6 , Matrix presentation of a Doolittle solution. Least squares and correlation 
constants can also bo obtained from the entries of a Doolittle solution. We first 
outline a matrix description of the DooUttle solution of the equation AX’ *■ G 
with A «* lufj] symmetric and of order n. 

Let Si be a (» by n) matri.\’ with the first row composed of the elements an 
and all other ©lements 0. Let Ti be a similar matrix with firat row elements 
bif *• aij/an and oil other elements 0. Then A — jSITi = Ai = [Oi/.i] is a sym¬ 
metric (n by n) matrix with all elements of the first row and the first column 0 . 

Next let ft be a (n by n) matrix \vith second row elements oa.i = Ojy — 0416 )/ 
and all other elements 0. Let Tj be a (n by n) matrix with second row elements 
bi /,1 = osii/oaii and all other elements 0, Then it follows that the matrix 
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Ax - S'iTi = [a., ii] is a ajinmetric (» by.n) matrix witk tlm pipmcnt* of thp 
first 2 columns and the first 2 rows all 0. 

This process is continued through Kuceesaive an arlditiorial row and 

column being made identically 0 at each atop, through n Rtejw. At the end of n 
steps we have the result. 

(21) A - S'xTi - -« 0. 

Tills development, when applied to each side of the matrix cHjuation, provides 
the basis for an equation solving technique which Aitken haa oallwl the "method 
of pivotal condensation" (8) but wluch the author feels is mom wltMiuately 
characterized as the "method of single division" (9). "nie Abtm‘viaUvl Doolittle 
method can be obtained as an abbreviation of this method. It is not neees* 
saiy to compute all the elements of the sucees-rive matrices AiAt ■ • • , etc. but 
only the non-zero elements of the Sx , 7'i , .S'l, ITj ■ • etc. matrices. 

Consider the so called triangular matri.x A’ = .S’l + iSj ,S's + ■ ■ ■ + with 
its rows composed of the non-zero rows of the .S',. Consider siIko the matrix 
T = Ti -H Ts -f ■ ■ ■ -h . Then 

(22) B'T = S'lTi -1- + ... + .Sin 

since 5’iT j = 0 when i 9^ j. 

It follows that (21) can be written 

(23) A - S'r = 0. 

An efficient way of building up these matrices .S’ imd T in practice and in making 
the corresponding transformations on the right side of the e<)uatinn i« the 
Abbreviated Doolittle method. It is apparent from (23) Uiat the Doolittle 
method is directed, in part at least, toward the factorization of the aynmietric 
matrix A into two triangular matrices. 

It should be noted that these triangular matrices are related tiy Uu* matrix 
formula 

(24) S = DT, 

where D is the diagonal matrix with diagonal elements On , os* i , 12 , • •. , 

Onn'lSS ■•/»—! • 

Operations performed on the left of the matrix equations AX « G am also 
performed on the right side so that the Doolittle technique results in thc» wtali- 
lishment of the auxiliary matrix equations. 

(25) SX « 

(26) TX » TA-^G. 

A simple outline (n = 3) of the foiin of the Abbreviated Doolittle method is 
presented for the purpose of identifying the.se matrices. A is symmetric and 0 
is the column matrix [a,d. 
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Oil flis flu 

flu 

“ an On 

j 044 

■ ' Om 

j Om 

Oil Oti flia 

Ou 

1 hvi bit 

bu 

n«-i Ou-i ! 

aj4.i 

1 bni \ 

^■1 

a«-» 


1 

bn.n 


Th(‘ matrix H is then 


an ais 
0 a« 1 
0 0 


au 
Ou-l 
««i*_ 


the matrix T is 


1 hit bia 

0 1 bjj.i 

, SA V/ is 

~0,4 

au-i 

, rA“‘G is 

'hu ~ 
bn 1 







6. Least squares and multiple correlation constants from the Doolittle solu¬ 
tion. The inverse of A is lunrdetl for many formulas. We set up a technique 
for solving .iF « I Bimultanecmslj with AX = G. This is indicated sym¬ 
bolically by 

A ! i^A~'G 

. 4 - 

T 1 TA~'G 

It follows at once that 

(27) (SA’')'(rA"‘) - A-'S'TA-^ = A~‘AA“' = A"’. 

This nmtrix multiplication is easily and readily accomplished when the matrices 
are in the Doolittle form. 

Similarly 

(28) (iS'A'‘)'(jrA ‘6’) « A“Vr =a A', the nmtrix of solutions of AX - G and 

(29) (,SA“'f?)'(7’A"'0) « G'A-'O. 

ll is interesting to note further that (-SA“*)' and T are inverse triangular 
matrices since 

(30) (^;A"‘)'r » A-^S'T - I. 

S' and TA~^ have a similar relationship. 








88 


PAUL 8. DWITBK 


In the cose of least squares theory A » X'A', d X'F, X U so that the 
formulas (27) (28) (29) become 

(31) (SA“')'(2'A"') = A'' = (X>XT\ 

(32) (SA-')'(rA"'(?) = X = B. 

(33) (5A"'(?)'(7’A-'G) = G'A~'0 « rXfX'Xr'X'F 

- Y’Xli » IVrXH - Y l\ 

If the normal equations are reduced to standard form d « K, X' B, (t ’' 
and we have 

(34) iSA'^iTA-^) = A'‘ = R~\ 

(35) (SA'^iTA-^G) = X = B. 

(36) (SA"'(?)'(TA-'(?) = G'A-^G « = iCh B'/(B 

The reader is referred to an earlier paper [3, 457] for an illustration of thtw tech¬ 
niques. 

It should be noted that the solution is a cumulative one in the sense that solu¬ 
tions involving n predicting variables are obtained from solutions involving 
71 — 1 predicting variables by the addhtion of paired products. This is a highly 
desirable feature as it makes possible direct analyses showing the e.flect of an 
added predicting variable. 

7. A more general theory—solution of matrix equations by factorixationr 
Examination of the results of section 6 leads one at once to a conaideratian of a 
more general theory. The key formula m tliis development ia A 8'T « 0 
and all subsequent formulas stem from this. Hence if A can Im factored into 
any matrices, S' and T, not necessarily triangular, the results of section 0 follow. 

From a practical standpoint it is desired that the factoriaation process yield. 
Simultaneously, the values S, T, SA~'G-, 3’A~*G; »SA"‘ and (TA"'* as the Doolittle 
method does. But, formally, these can be computed if B and T are known. 

8. A "square root" method. A most interesting and practical special cose 
of the above method is that in which the triangular matrices S and T are equtd. 
It appears that a technique based on this property would have some advantages 
over the Doolittle method since the double rows of the Doolittle fiolution could 
be replaced by single rows, while the formulas of sections 6 and 6 are juat m 
applicable. Now such a technique is easily devised. From (23) and (24) we 
see that 

(37) A ~ S'D-^S - 0, 
where D is a diagonal matrix. 

We replace D~^S by a new S, (D~‘jS)' by a new S' and have 

(38) A ~ S'S = 0. 
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'Ilif t<‘(*hnkjuf of M»tu(ion i« tfinuUir fo that of fhe Dooliltle excppt that the 
(•ntrif'K area,,. ,■%/«„. • Thw value,s s,, are thus geometric means 

of the vaUiefc, atwi f;,,. , 

A eimple raaehine fechniijup is available for computing these entries. In 
some resiXTtfs the aolutinn i« HU{>erior t(t the Doolittle solution. It i,s hardly 
iwrfincnt to the svibjeet matter of thin puiXT to prewmt a detailed discuiiHion of 
the meritfi of thia metluKl, with the numerical ilhiKtrationK. This will be done 
in a later i)ai>er. 

After arriving at this metluKl by the steps described above, it seemed surpris¬ 
ing that sficli a .simple and eompaet method has not been discovered by some 
previous worker. Although matrix faetorissation is not a new subject, I have 
not found evidence that it has been utilisscd so directly in the problem of solving 
matrix equation.*?. The nearest approach I have di.seovercd is the paper by 
Banoehiewics (lOJ. in which a “square root" method is used in factoring A, 
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ON THE STATISTICS OF SENSITIVITY DATA 
By Benjamin Epstein and C. West C’Ht'K(rHM\N 
Frmkjofd Arsenal 


1. Introduction. '‘Sensitivity data." is a KPi'f'i'fd tvpr iif es- 

perimentai data for whieh the meaauremmt at any point in tlin scaip dfwtrny.s the 
sample; as a consetiuence, new Riimplw are nHpuretl for earfi detymuimtirm. 
Examples of such data occur in IholoRy in ilosaRe-mortality determiruitimis, 
in psychophysics in questions eoncerninR sensitivity r'WpnnM*s, ami, more 
recently, in the theoiy^ of solid explosives, in questions rnncpriiinR the wnsilivity 
of explosive or detonative mixtures. 

Methods of analyzing such data have been discuiwl by BHm* and .Hjwarmtin®, 
and others. The present paper is a generalization of .Spearman's result; it is the 
feeling of the authors tliat .Spearman's method, if pro{HTly foimdwi in matiu^ 
matical theoiy, is preferable to Bliss’, for it does not nectwitale the assumption 
of some type of distribution prior to analysia, and henei' ri'sembles the slandanJ 
treatment of independent observations made on tlie same otiject. 

Throughout the following discussion, we let x, be the magnitude of a certain 
‘‘atimulus’’ (be it dosage, physical stimulus, or strength of hlowi and p, the cor¬ 
responding fraction of objecUi unaffected by the stimulus, Bltas' mclhtKl con 
sisted in assuming that the p, repreacnteii the cumulative diatribulion of aotiip 
known function (in his case, the normal function), and hence the p, could be 
transformed into a variable t, linearly dependent on the x,. Tlip clifFiciilty of 
this treatment, in addition to the distribution aasumptian. lies in the fact that 
the (i do not have equal standard errors, and the straight line fit is vpyycumlMir- 
sorae. 

Instead, Spearman makes the much simpler ai«umption that if p, m unaffcctctl 
at xi , and p,+i at i<+i, then p( - p,+i is an estimate of the fmctiwi that is just 
affected (i.e., the fraction of those that have "criticar’ responses) at about 
Hxi -f- x.+i) If the Xi are evenly spaced, as we shall assume them to be through¬ 
out, and Pi = 1.0 and p„ = 0, then any set of sensitivity data may l>e trans¬ 
formed into a set of data on critical responses classified into claases whose mid¬ 
points are evenly spaced. Without loss of generality, we shall assume the x,’s 
to be integers and the intervals to be unity. The data on critical rMpoiMea can 
then be treated m the norrnal way, and X and all the measures of dispermon 
calculated in the usual fashion. In order to justify such procedures, however, 
It is necessary to show how the sampling errors of X and the higher moments 
can be estimated, 


oioflS; V# Bi- 

»0 Speaman, “The method of ‘right and wrong cases’ (constant s timuli) without Gauss’ 
formulae.” Briltih Jour, of Psych., Vol. 2,190S, pp. 227-242. 
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2 . Ttie moments and their errors. By (iefinitii)n, 

(1) X ■- ^ ip, - + t .+,)/2 = Z (p. - p.+i)(T. + 1). 

If \vi‘ let jr, tli(“ ■stimulus fur which niitie of tlic Miinplcs can he affected, 

then 

rtf-1 

(2) a:, + .5 + E p,, 

<-s 


a** S|ieannan hae ehown (3). Since i.s constant, and the p, are all independent 
(non-correlat«i), if followh (hat (.V, hcing the munlicr of objects in the fth 
sample) 


(3) 


tfi, 


' Tit 


+ 




V = V E’ 

N, 


{since ffp, “ flip, » 0 ). 

.Again by definition, (ho r/th moment about the origin is 


( 4 ) 


pi = L (p. - P.ii)(-r. + J)'- 


As liefore .ri + .5 can bc‘ taken us the orijidn (ji + .5 i=- D), in whinli case we have 


(5) 


ai “ (pi - Th)’0^ + (pj ■“ Pi)-!* + (pa - Pi) -2' 

•f ••• -I- (Pn-i - Pn)(n - 1)*. 


If we let h,., represent the ith first difference of the consecutive t/th powers of the 
positive integers (including 0 ), then 


( 0 ) 


pi = E f>«..p 

fMlfi 


\ > 


by expansion of (5). 
Evidently 

(7) 


Hereafter all S will be taken from i = 2 to i =* n — 1. 



or 

( 8 ) 


” E ■ 

i^t 


We are interested now in the standard error of the 5 th moment about the sample 
mean. To obtain this, compute first the correlation between the gth and rth 
moments about the origin. 
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If S^i' is taken to be the sample error in 'im' dmininm'* f»om tin- true 
values, then we have 

in* 

5po ^ hg I ^Pt 

I—2 

w*l 

Jm* =* 53 • 

l~S 

Hence 

6i/,&i/r = 53 1j«.i "i* 53 • 


Summing for all samples: 

~ 53 b,,,br.ia\^ + 53 iK.Jff.i + hsj Ilf iKvjfjefj), 

(9) ■'*' 

* 53*,..^/..wr*., 


Since evidently fp,,, vanishes for all i j (the p. heing enrnplPtely tHdf‘i«*nflfnt 
in the statistical sense). 

In particular, when = X, we have 

(10) vpjasrp;,y »« S6i.w’, . 

By definition, the ?th moment about the mean will Ur* 

(U) itt « S(pi - p.Hi)(jr( + h " « -p'fj. +• i - ..t»* 

where p< = p, - p,+i. 

For computational purposes, this may be written as 

(12) n, == ji[ — gXjji-i + iXV»~i +•••+■ fCr f»i + * * ‘ 

where i' = 2p, = pi , if Xi + Hs Ihe origin. 

To obtain tr’,, where X is estimated from the aample, ive may follow the usual 
procedures, arguing that 

(13) V, = 2((X( + i)Vit “ iiXZ{x, + ^)’ y, + T 

where T contains terms involving X and higher powern of X. 

From (13) we obtain 

(14) vj, = ffj; + - 2gMj-iirSir„5ry,; + V 

where II involves X and higher powers. From (3). (8), (10) and (U) wo liavp 
(l^) <r*, =5 SbJ.dr],^ + g*a*-io'>.j *" -+■ U 

= S(b„< - qp,~i)*(r\i + U> 

We now shift the origin to X. All the terms in U vanish, becomes , 
and the h„< values go into j3,,i, where 

- a - 2)' - a - 1- - X)’. 
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That is, (15) becomes 

(16) = S(^,.. - g,^,_i)V?„ . 

It is of interest to give an alternative proof of the relation (16) possessing the 
desirable property of being very short and simple and at the same time yielding 
an expression for the 0^,, in terms of l)r.,(l < r < g) and powers of X. 

If a:i + 5 is taken as the origin, then (11) may be written as (17) 

(17) a, = S(f — Xyp[ . 

The application of the S-operation to both sides of (17) yields; 

(18) Sm, = X(f - X) V - gS(i - X)^ytSX 

(19) = X (/3,,. — g^,_i)5p(. 


Repetition of a previous argument gives the result: 
(20) = XG8,..- - gp,-i)Vt. . 


In order to denve the relation connecting the with 5r,,(l < r < g) we 
expand X(t — XySpt in equation (18). This expansion yields: 

S(f - X:y5pi = Z(t" - ,C,i‘-^X + 


( 21 ) 

i.e., 

( 22 ) 


+ .•• + {-iy-\c,.,iX^-^ + i-iyx*)&p'i 

— 2 (.bf.i — + (dabj-i., 5’* 

+ ... {~iy-^qX^-%,i)5p^ 

+ ... + (-l)»-'gX»“V<. 


The relationship (16) combined with (22) enables one to compute the standard 
errors of a number of useful statistics. In particular in case g = 2 it follows that 

(23) cr’, = a-U = X( 62 ,i — 2.X^)Vp, . 


Combining (23) with the well-known result that 


(24) 

we see that 

(25) 


<r, = <rp,/2 


(T 


VE {(2f - 3) - 2X}\1, 

2VS (2r -3)p. - (S)’ 


Formula (25) is useful in significance tests involving the standard deviations of 
sensitivity data. 


3. Standard errors of the moments in standard units. We now turn our at¬ 
tention to the derivation of the standard error of the higher moments when 
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expressed in standard units. Before pioeeedinp; with the derivation it is enri- 
venient to find the correlation between the gth and rth moments atioiit the mean. 
This result is an immediate consequence of (19J, for .‘•ince 

S/ij = — 5 /Mb-i)5p. 

and 

(26) 5^1. = 2|i3... - r^r-t]Sp, 

it follows that 


(27) = S{)3b,. - l^r.. - rnr-il (6p.)* + Z 

where Z contains tenns Sp,Spj(i 9 ^ j) Hence, fis before, 

(28) l/Jr.i 

Let US now derive the standard error.s of the moments in standard units, j.e., of 


(29) 

Now m general, 

(30) 

and since 

(31) 

we have 

(32) 

and hence 

(33) 

(34) 


Sctg == 


trin, ~ 

(r’« a®'''* 


(Sa,) 


Sii 2 = 2<rS<r , or Sa = ini/la 


, 2(r 5a« — gPc Sfij 

-SST" ^ 




4ct2(»+3) 


3 _ 4- gVio-y; - 4g;ian,(r„,iT„, r,„,. 


4/i2 


1+2 


In this case, it follows that 
(36) 


Z 

O-aa 


4/12 2 ~ 5/‘2-i)*<rpi + £ 02,1 Vpi 

_ - 4gnB/i2 Z) (|8 ,.t - (?/i.-i)|9a.j o-t. 


or 


2 ^ (2/12 (g,.j — g/ig-i) — g/iB^2„-)V^f 


-'er^ 


(36) 
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If the Q-th moment about the mean vanishes, then 

(a/) o-tf, - 

4^1s /2j 

It is readily been that the standard errors of the skewness and flatness are special 
cases of formula (36) when ^ = 3 and q = i respectively. 

4. Some minimization problems. In the analysis of sensitivity data it is most 
desirable to minimize ax or aU in order to increase the precision of significance 
teats involving .S or o- respectively. Therefore, it is of interest to solve the 
following problem; Suppose that we have a sample of size N which is to be sub¬ 
divided into n samples of size Ni to be tested at a number of fixed lev'^els (z,) 

n 

f = 1, 2 • • n, 23 IVi = fV. Tlien what choice of values {A^,} will minimize 
1-1 

trl = 23 I where N, = N? 

1-1 iVi 1-1 

In order to solve this problem mast quickly we use the method of Lagrange 
multipliers, i.e., we minimize the expression 

(38) U(Ni . = E + X (E N,-Ny 

Taking the partial derivatives with respect to Ni we obtain the n equations 

(39) = i-e-. = f=l,2...,n. 

Summing over all values of i we obtain 

(10) or 


E Vpii^ 


i e., the best choice of values for {A'',) is given by 
(41) = 

E ^\/p^q^ 

4—1 

The value of cry for this choice of the set {A'',-} is 




It is obvious that this is actually a minimum. In particular, it is less than the 
value of ffj for iVj = N, = N/n (the number of groups is n). This follows from 
the application of Schwartz’ inequality to (42), for 


( n _B 

E-N/p.g<) nXiPi9<> 


< ■ -b 
N 
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which equals the value of al for A'l = JVj 
holds if and only if pt = P 2 = 

Suppose next that we wash to minimize 


(44) 


1 _ (fh.i ■“ 2^) p,Q, 


™ q'he equality 





where 

fi),{ = hj.v ~ 

We proceed as before to minimize the exprtimon 

(45) l ,( n : , X) - g + X (t jv; - iv). 

Taking partial derivatives with respect to X', we obtain 


(46) 


/Sa.tPigj 


X i.e. W; 


I Vp.g. 

“ -v/j- ' > 


t « 1, 2, 


n 


or summing over all values of i we obtain 

= V \llAylki3.' or X’" = >/?• ?.. 


(47) 


N ~ Tl ^ 

h. x'» 


i-i 


i e., the best choice of values for (iV;) ia given by 
(48) 


=S ^ ifai I VPiQi 


S Ift.H Vp.g* 


The minimum value of vN is given by 


(49) 


^Sj/Sa.il Vp.g<^ 


N 


N 


In practice we desire a set {A’l) which will make and (tU small simultane¬ 
ously. Unfortunately this is not in general possible. In fact, it may be asserted 
that the set {N,} minimizing, aj will yield a large value of o-Ji and similarly the 
set 1 n[ ) minimizing aji will yield a large value of trj. The reason for this curious 
behavior lies in the fact that the only difference between the set (iVd and the 
set \N',] is the set of numbers { ()3i,i 1) » { | (2i - 3) ~ 2:S' | i. Th^ num¬ 
bers, however, change the character of the sets [N{\ and (Wil. In particular 
I A. I takes on its largest values for both small and large values of t, whereas 
[N ,) takes on small values in these regions; [N'i] takes on small values for those 
values of t which are the integral values closest to ^ -f 3/2, whereas (A',) takes 
on large values for such values of i. It is this curious juxtapewition of (2^,-] and 
{Ni\ that renders it impossible to choose sets of numbem (Wv) minimizing (r| 
and <r,i simultaneously. 



NOTES 

This section is devoted to brief research and expository articles, notes on methodology 
and other short items. 


NOTE ON RUNS OF CONSECUTIVE ELEMENTS 


Bt J, WoLFOwrrz 
« 

Columbia University 


In my paper [1] I did not derive the asymptotic distribution of W{R), an omis¬ 
sion which I wish to correct in this note. 

Let the stochastic variable R = (xi, • ■ ■ , x„) he a permutation of the first n 


positive integers, where each permutation has the same probability —;, A sub- 

n! 


sequence Xi+i, a:<+j, • ■ • , i.+i, is called a run of consecutive elements of length 
I if; 

a) when V is any integer such that I < V < I, 


I ~~ *<+!'+! I = 1 

b) when i > 0, ] a:,' — x,+i | > I 

c) when i + I < n, \ z.+i — x,+(+.i | > 1. 

Let If'(K) be the total number of runs in R. Then n — W{R) ts a stochastic 
variable which, it will be shown, has in the limit the Poisson distribution with mean 
values. More precisely, if p(w) is the probability thatn — = w, then 

2 “ 

(1) lim piw) = . 

n-*oo 6**Wl 


Proof: Define stochastic variables yiii = 1, 2, • • • , n), as follows: j/, = 1 if 
X, is the first element of a run of length 2, y, = 0 otherwise. It is easy to see 
that the probability that x,(i = 1, 2, •••,») be the initial element of a run of 


length greater than two 




and hence that the probability of the occurrence 


of a run of length greater than two is 0 


©• 


Hence the limiting distribution of 


n — ir(f£) is the same as that of 



provided either esdsts. 

The V,' are dependent stochastic variables and almost all (i.e., all with the ex¬ 
ception of a fixed number) have the same marginal distribution. We now wish 
to consider the expression 

E{y:^yV 


(where the symbol E denotes the expectation) for any set of fixed positive in¬ 
tegers fc, on , ‘ , at, and for all fc-tuples ii, M , • • • , ik, with no two elements 
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equal. Now 


is the probability that j/n = li J/ij — li * ■ ‘ • Vn 


Vn) 

1, feimultaneoualy. 


b 1 


probability is either zero (for example, when | tj 
or when t, = a. etc.) or + Q ■ Moreover, the 


Thia 

1, I 4 ts j l, etc. 
ratio of the mmiher of 

fc-tuples 4,4, • • • , 4 for which the probability i.s ww to the number of A-tuple« 
for which the probability is + 0 ^-*+ 1 ^ ^ 

independent stochastic variables each with the same distnbution such that the 
probability that = 1 is 2/n and the probability that Zi = 0 is (» - 2)/n. 
It follows readily that the limit, as n -+ ». of the jth moment (i =- 1, 2, ■ • • , 
ad inf.) of y about the origin, is the same as the limit of the Bhme moment of Z, 
where 

Z « 23 • 


Since the Z, are independently distributed, and since each can take only the 
values 0 and 1, the probability of the value 1 being 2/n, the jth moment of Z 
about the origin approaches, as n —♦ «>, 




a t! ’ 


which is the jth moment about the origin of the Poisson diatribution with mean 
value 2. By the preceding paragraph, ns is also the limit of the jth moment of 
y about the origin, Now von Mises [2] has proved that if the jth moment 
(j = 1, 2, ' • ■ , ad inf.) of a chance variable , (n = 1, 2, ■ • • , ad inf.), ap¬ 
proaches, as n —* «, the jth moment of a Poisson distribution, then the dis¬ 
tribution of X„ approaches the Poisson distribution with corresponding mean 
value. From this it follows that y has in the limit the distribution (1). We 
have already shown that y and n — W{R) have the same limiting distribution, 
BO that the required result follows. 
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NOTE ON CONSISTENCY OF A PROPOSED TEST FOR 
THE PROBLEM OF TWO SAMPLES 

By Albert H, Bowkeu 
Columbia Univcraily 

Certain tests for the hypothesis that two samples are from the same popula¬ 
tion assume nothing about the distribution function except that it is continuous. 
Since the power functions of these tests have not been obtained, optimum 
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tests are not known. However, one desirable^ test property, that of "consist¬ 
ency,” has been introduced by Wald and Wolfowitz [1]. A test is called con¬ 
sistent if the probability of rejecting the null hypothesis when it is false (the power 
of the test) approache.s one as the sample number approaches infinity. This is a 
logical extension of the familiar idea of consistency introduced by Fisher. It 
will be shown that a test recently proposed by Mathisen [2] is not consistent 
with respect to certain alternatives. 

The test propased by Mathisen [2] may be described briefly as follows; Given 
two samples, observe the number (m) of elements of the second sample whose 
values are leas than the median of the first sample. The distribution of m is 
independent of the population distribution under the null h 3 fpothesis. Let 
P[in < a) denote the probability of the relation in braces under the null hy¬ 
pothesis. If -mi and mi are significance points (mj > TOj) such that 

P\m > mil = j8i 

(1) P[m < mi\ = 

i8i -h ft = i3 < 1, 

the statistic m can be used to tefet the hypothesis at the sigmficance level /8. 
This is called the case of two intervals The method is extended by using the 
two quartiles and the median of the first sample to define four intervals into 
which the elements of the second sample may fall If the second sample is of 
size 4rt and the number which actually falls in each interval is ni, n*, nj, and 
rii respectively, the distribution of 

YL (n.’ — nf 


is also independent of the population distribution under the null hypothesis. 
Then if C* is a significance point, such that 

(3) P[C > C*\ = ft < 1. 

C can be used as a test of the hypothesis at the level p'. 

To show that Mathisen’s test is not consistent, we shall consider firat the case 
of two intervals Let X and Y be two independent stochastic variables whose 
cumulative distribution functions F(x) and G{x) are continuous. Let 
Xi < X 2 • • • < xj„+i and y\<yi • ■' <yin be sets of ordered independent observa¬ 
tions on X and Y. Then m is such that 


ym Tn+l 1/m+l • 


Let mi and tth be the significance points of the distribution of m, defined by 
(1). Clearly mi and m* depend on n. Wc shall prove that the sequence 


(4) 


mi(n) 

2n 


n = 1, 2, 


'For large aamplea. 
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converges to Since (4) is bounded, it has at least one limit point. Ixt h 
be such a limit point. If iv < ^ and -J — h = 35, then there exists a monotoiiically 
increasing subsequence of the integers ni, ih, • • • an<l a number .V such that 
for n, > N 


( 6 ) 


miim) 

2n, 



< 5. 


Clearly m/2n converges stochastically to Hence if 0 < e < 1 is any arbi- 
tranly small number, -we can select n so large that the prohahiUty is at least 
1 — e that 


( 6 ) 


— 

2n 


1 

2 


< 5. 


Hence for n sufficiently large, P(nt > mi] is at IcAst 1 ~ a contrarlietum with 
(1). A similar contradiction appears if h > Hence (4) has only one limit 
point, In the same way we can prove that the serjuence 


(7) 


mt(n) 

2n 


a 1,2, • • ■ t 


also converges to J. 

LetO < 6 < J, Consider now two pairs of populations, A and B, deacrilKSHl 
as follows: 


A) F(x) w G(®) » X 

B) F{x) » X 


(0 5 X < I ) 
(0 < X < U 


G(x) » 0 


(0 < X < i - 25) 


G(x) E (x - i + 25)(i - 5)/6 
G(x) = X 


(i “ 1:^5 < X < § - 6) 
— 5 ^ X ^ ^ 5) 


G(x) a=J4-« (i + 5<x<i — 5) 

0(x) = (i + i) + (a, _ 1 _|_ s){i - s)/S (1 - 6 < X < 1) 

For both A and B, F(x) s G(x) s 0 for x < 0 and F(x) « G{x) « 1 for x > 1, 
For B, it will be shown that there exist values of n greater than any preaBsigned 
arbitrarily large number, such that the probability of rejecting the hypothesis 
when it is false is less than + ft + t where e is an arbitrarily small p(»titive 
number. 


Let hi,ht,hi denote the number of observations on X which fall in the inter- 
vals 0 < X s i ^ 5, i - 5 < X < i + 5, i + 5 < X < 1 respectively for a fixini 
value 01 n ^t hi, hi, h, be the corresponding numbers for Y. For a fixed 
n, the probability of a Set hi, hj , h,, h', hj, hj is the same whether the samples 
be drawn from A or B From (4), (7), and the stochastic convergence of m/2n, 
It follows that we can find an N such that for all n > iV the probability is at 
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Jeafit 1 — «/2 of the occurrence of a set Ai, /ii, h,, hi, h'l, h[ for which ym ^, 
2:n+i, j/ma Will fall in the interval (i — i + 5). Furthermore, for fixed hi , 
hi the distribution within the interval is the same whether the sample came from 
A or B. Hence, even when the sample is drawn from B, for n sufficiently large, 

Plm > mi) < Pi + ~ 

P{m < mi] < pi + 

That is, for samples of sufficiently-large size from B, the probability of rejecting 
the null hypothesis is at most fii + Pi+ t. Since fi} + fii < 1 and «is arbitrarily 
small, the probability can be made less than one and the test is not consistent 
in the case of two intervals. 

In the case of four intervals, the proof is similar. In this case, we assume 
that the second sample has size 4n. Clearly, ni/4n, ns/4n, nj/4n, and nt/in 
converge stochastically to i. If C* is the significance point defined by (3), the 
sequence 

C*in) n = 1, 2, - • ■ 

converges to zero. Now consider two pairs, A and B, of populations. A is the 
same as before and B consists of one uniform distribution and one which is 
identical with the uniform distribution in small intervals containing x = i, 

J, and 1, but is different everywhere else. As before, F{x) ^ G{x) » 0 for 
a: < 0 and F{x) = G{x) s 1 for re > 1. Then for B, when n is large, the be¬ 
havior of C, except for a probability arbitrarily near zero, will depend only 
on the intervals of coincidence. Hence for B 

P{C > C*] < P' + t 

where * is any arbitrarily small positive quantity. 

Returning to the case of two intervals, if the samples are from different popula¬ 
tions and if their cumulative distribution functions are identical in the neighbor¬ 
hood of their medians, the test is not consistent. If such a possibility is excluded 
from the class of admissible alternatives, we may expect that the test will be 
consistent. For example, if the class of alternatives is limited to those where 
G(x) F(x -h c), c a constant, the test will be consistent. A similar remark 
holds for the case of four intervals or for any fixed finite number of intervals. 
It appears, however, that if the number of intervals is a function of the sample 
size (say ■\/n) £iud becomes infinite with sample size, a test of this kind will be 
consistent with respect to a general class of alternatives. 
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HENRY LEWIS RIETZ—IN MEMORIAM 

By a. R. Crathohne 
University of Illinois 

Forty odd years ago few if any American college catalogs mentioaed. the words 
“mathematical statistics.” The word “actuary” often called for the use of a 
dictionary. Some courses in the theory of probability, theory of errors, or 
method of least squares touched on some phases of statistics but aside from this 
there was little interest in the subject. In England at this time Karl Pearson 
was well started in his work at University College but "Student” was an under¬ 
graduate student In Germany, Lexis was finishing his somewhat unrecognized 
labors at Goettingen. In Denmark, Thiele, and in Norway, Charlier were lee- 
tunng and writing on statistics from their own individual viewpoints. 

During the four decades which have passed, the interest in theoretical statistics 
in the United States has increased to the point where it has a well established 
journal of its own and few university mathematical departments fail to list 
statistical courses. In this growth no one has had more influence than the sub¬ 
ject of this memoir. His published papers, his personality, his students and his 
well directed energy have all been more than helpful in putting mathematical 
.statistics where it is today. 

Henry Lewis Rietz, son of Jacob and Tabitha Jane Rietz, was bom August 24, 
1875 at Gilmore, Ohio. He attended the local schpols and in 1895 entered Ohio 
State University receiving his B.S. degree in 1899. After graduation he went 
to Cornell University as scholar, then fellow and assistant in mathematics. 
During his stay at Cornell he was closely associated with two other mathematical 
students, J, W Young and H. W. Kuhn, later heads of the departments of mathe¬ 
matics at Dartmouth and Ohio State University respectively. In his last year 
Rietz was particularly interested in group theory and worked for his doctorate 
with Professor G A. Miller who was then a member of Cornell’s faculty. His 
dissertation was “On primitive groups of odd orders,” published later in the 
American Journal of Mathematics and referred to in the Encyclopedie des Sciences 
Mathemaliques. After receiving the Ph.D. in 1902 he spent one year as professor 
of mathematics and astronomy at Butler College m Indianapolis. 

In 1903, Rietz accepted an instnictorship at the University of Illinois where he 
stayed until 1918 becoming full professor in the meantime. In 1918 he was 
called to the University of Iowa as head of the department of mathematics, a 
position he held until his retirement in 1942. 

During his first year at Illinois his interests Were mainly in pure mathematics. 
His advanced courses were “Theory of Invariants” during the first semester and 
‘Higher Plane Curves” during the second. During the next year a demand 
arose for some course in statistics. None of the members of the mathematics 
department were particularly prepared to give such a course but Rietz was 
induced to try it. The result was that he offered a course "Averages and 
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Mathematics of Investment ” This curious title was evidence of the fact that 
actuarial science had not reached the independent position that it has at the 
present time In the following year he was appointed to the position of statisti¬ 
cian of the College of Agriculture and from that time on during his stay at 
Illinois he divided his time equally between the department of mathematics and 
that college. His work as statistician was mainly supervision of the statistical 
work in the published bulletins. The first publication in the statistical field 
under his name was the 32-page appendix to Dean Davenport’s treatise on 
breeding. 

The first published statistical study was in 1908, a master’s thesis for Miss 
Shade on “Correlation of efficiency in mathematics and in other subjects,” 
printed as one of a series of University Studies It is interesting to recall the 
attention which this paper received, especially fiom educational circles. It 
seemed to fix the method and form of calculation of correlation coefficients which 
occupied the time of many people during the following years. In these early 
years it was rather difficult to find a place of publication for a mathematical 
paper on statistics. Mathematical journals were somewhat reluctant in accept¬ 
ing articles. I remember one occasion when he jokingly complained of the 
correspondence necessary to explain to an editor the word “correlation” used 
in a paper. 

From 1908 on, Rietz published a long list of papers on statistical topics, some 
purely theoretical, some expositional, some arising out of his connection with the 
college of Agriculture. Together with his later actuarial studies the list totals 
150 titles, the more important of which are included in this article. His much 
quoted paper of 1920 on “Um Schemata” pleased him more than any other paper 
His little book Mathematical Statistics, one of the Carus mathematical mono¬ 
graphs, written in 1926 was the basis for many university courses for years 
afterward. 

In 1909 the American Institute of Actuaries was organized in Chicago, and 
Rietz ivas a charter member. He took particular delight in this organization 
and was rarely absent from the meetings. He was elected vice-president in 
1919 He liked meeting practical actuaries and had a wide acquaintance among 
them In 1916 he was appointed a member of the Illinois Pension Laws Com¬ 
mission and became its actuary From that time on his interests were pretty 
evenly divided between mathematical statistics and actuarial problems connected 
with pensions. He vas appointed actuary of the Chicago Pension Commission 
in 1926, Avas con,sulting actuary for the Pre.sidents National Committee on 
Economic Security 1934, and was a member of the board of trustees of the 
Teacher’s Insurance and Annuity Association 1934-38 His services as a con¬ 
sulting actuary were sought by a great many pension projects both in educational 
and in business circles. When he ivent to the University of loiva in 1918, he 
accented actuarial theory in his teaching. Under his leadership the department 
became an'outstanding school in this field Many of his students hold prom¬ 
inent positions in the actuarial world 
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In 1923, Rietz with oiglit others was appointeci a menilter of the Conmiittif’ 
on the Mathematical Analysis of Statistics of the division of Physical Srieiices 
of the National Research Council. The work of this cominiltw developctj into 
the preparation, of the “Handhnuk of Mathematical vSufhticrs" with Hietz as 
Editor-in-Chief. This work had considerable use for a iuimfK>r of years after it.s 
publication and is an important part of the liistory of mathematical statiKtics 
in this country. A Russian edition of thw hook apfK'arcd in 1927 with a very 
long preface as a sort of apology for the translation, A few excerpts from this 
preface are-~“Mathematical statistics is a purely teehiiical weapon, intlilieally 
unbiased, can serve with equal facility either to thwart or to expedite the inm-e- 
mentfor the emancipation of tire proletariat depending in wh(wt‘hands it hap[H*ns 
to be;” '‘Mathematical statistics ha.s nothing to do with phiUwophieai enlighten¬ 
ment;” "Hence this book harbors no dangers for a soviet reader;” “The fact that 
the western authors work in a bourgeois society has no bearing on their mptlnxls." 

The Institute of Mathematical Statiatics was organized in 1935 with Rietz as 
the informal chairman of a steering committee during the months of discussion 
preceding the organization. He thus became the logical first president. He 
has taken a more than active interest in the Institute,—as a contributor Ui 
the Annala, as one of its editors, as general counselor, as a giKsl friend. In 
appreciation of this and in recognition of hia contributions to the initiation and 
development of mathematical statistics in America, the 1943 volume of the 
Annala of Malhemaiical Slalialics was dedicated to him, on the occasion of his 
retirement after twenty five years of service as head of the department of mathe¬ 
matics at the University of Iowa. 

Professor Rietz received many honors in other fields. He was President of 
the Mathematical Association of America in 1924, vice-president of the American 
Statistical Association In 1925, vice-president of the American Mathematical 
Society 1928-9, and a member of the editorial staffs of the RulleUn and the 
Transactions of that society for many years, president of the Iowa Academy of 
Science, 1931. He was starred in American Men of Science, a fellow of'the 
Royal Statistical Society of London, and of the American Association for the 
Advanrement of Science. Ho took great interest in local affairs and held many 
offices in church, social and business organizations in Iowa City. His mind was 
not altogether centered upon research and the development of mathematics and 
statistics. He took great pride in his teaching. He was the principal author 
of a number of college texts in mathematics that had wide use, and was on many 
conraittees concerned with the problem of teaching mathematics to under¬ 
graduates. 


At the time of his retirement. Professor Rietz was in failing health and was 
practi^Uy an invalid until the time of his death at the I’nivcmity Hospital at 

brother, Professor John Rietz, 
Morgantown, West Virginia, and a sister, Mrs. T. S. Taylor, Caldwell New 
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Rbi.ecteo TiTt.ea or PrsurATioNs by II. L. Rietz 

1. "On primitive groups of odd order," Amer Jonr nf Mnlh , Vol 26 (1904), pp. 1-30. 

2 "On groups in which portRin commutative opwations are eonjugati'," 7V(ins. dnirr. 

Math. Sac., Vol 5(19041, pp. 500-508. 

3 "Ritnply transitive groups which are simple groups." Bulleltn Amer, Math. Soc., Vol. 

11(1905), pp. 645-48. 

4. "Statisticnl Methods. Appruidiv to Principles of Breeding.” A Treatise on Threm¬ 

matology by B. Davenport, Ginn and Co., Boston, 1007, pp 681-713, 

5. "Correlation of efficienry in mathematics and cfTieiency in other subjects—A Statistical 

Study," Rietz and Shade, The University Studies, Urbana, Illinois, November 
1908, 20 pp. 

6. Statistical Methods Applied to the Study of Type and Variability in Corn, Eugene Daven¬ 

port and Henry L Rietz, Bulletin No. 119, Illinois Agricultural Experiment 
Station, 1907. 

7. "On inheritance in the production of butter fat," Biometnka, London, Vol. 7(1909), 

pp. 10&-126. 

8. "On a mean difference problem that occurs in statistics,” Amer Math. Month , Vol. 

17(1910), pp. 235-40. 

0. "On the metabolism experiment as a statistical problem,” Rietz and Mitchell. Jour, 
of Biol. Chetn., 1910. 

10. On the Measurement of Correlation- with Special Reference to Some Characters of Indian 

Corn, Henry L. Rietz and Louis H Smith, Bulletin No, 148, University of Illinois 
Agricultural Experiment Station, November 1910, 

11. "On the construction and graduation of a rural life table,” Rietz, H, L. and Forsyth, 

C H., Record Amer,/nsl. o/Acluor , Vol 1(1911), pp 9-19. 

12. "On the theory of correlation with special reference to certain significant loci on the 

plane of distribution in the case of normal correlation,” Annals of Math,, Vol. 
13(1912), pp, 187-199. 

13. "Note on the definition of an asymptote,” Amer Math. Month.,Yo]. 19 (1912), pp 89-90. 

14. "Tlie determination of the relative volumes of the components of rocks by mensuration 

methods,” Lincoln and Rietz, Economic Geology, Yo\ VIII, No 2, March, 1913. 

15. "On the mathematical theory of risk and Landre’s theory of the maximum," Record 

Amer. Insl Actuar., Vol. 11(1913), pp. 1-14. 

16. "On the status of certain current pension funds," Record Amer. Inst. Actuar., Vol. 

3(1914), pp. 33-53. 

17. "Group Insurance," Record Anier, Inst Actuar., Vol. 3(1914), pp. 277-79. 

IS. "Degrees of resemblance of parents and offspring with respect to birth ns twins for 
registered Shropshire sheep " (Rietz, H L. and Roberts, Elmer.) Jour.Agrtc. 
Rea , Vol. 4, No 6, pp. 479-610. 

19 "Note on double interpolation by finite differences," Record Amer. Insl Actuar., Vol. 

4(1916), pp. 15-22 

20 "On the correlation of marks in mathematics and law," Jour. Educ. Psych., Vol. 7, No. 

2, pb 87-92. 

21. "The operation o( pension laws Ln foreign countries," Report of Illinois Pension Laws 

Commission, 1916, pp. 19-36, 

22. "Actuarial Report on Pension Funds for Public Employees of Illinois," H, L. Rietz, 

and D. F. Campbell, Report of Illinois Pension Laws Commission, 1916, pp. 
72-199. 

23. "The underlying principles of a pension plan," H. L. Rietz, G, E, Hooker, and D F. 

Campbell, Report of Illinois Pension Laws Commission, 1916, pp. 272-284. 

24. “Report of Illinois Pension Laws Commission,” Rietz and others, 1918, pp, 310. 
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25 "Oiv the value of certain proposed refunds pB.vttlile a! the deatls of an annnitanl under a 
pension system," Record Anirr InU. dctnnr.. V<i1 (1U917!. jiji "h 

26. "A statistical study of some indirert effects nf certain selertHins in tin* InecdinR nf 

indion corn," Hicti!. H. h and Smitli. L 11., Jinir.oJ Agrtr Rtf Vn) n'l'.lKi, 
pp. 105-48. 

27. "Methods of providing for expenses of new liiiainess hy life itmuranre ciitnftafiicH," 

''Amer. Ecan. Rm , Vnl. 7f1!ll7), pp. tS.T2-3H 

28. "A Report to the Trustees of the C'arncgie Founflntioit hy the C'offimiiwitin C”liiMW>n to 

study and report upon the Proposed Plan of Insurance and AniitiitiM." Hints 
and ethers, Ifl pp, 

29. "PenaioDB for public employers," Amer Pofit. A'ct. Wreirm. Vol. lariUlhi pp » AH 

30. "Stalietioal methods for preparation for war department service," A mrr .Vfiitfi Month. 

Vol. 28(19191, pp. 99-100. 

31. "Recent developments in pension plana for publie employees," Bfmrtl Ainrr InU. 

Acluar., Vol. 8(1919), pp. 1-12. 

32. "Scope and advantages of courses of instruetirm on life insuninee in American rollegea 

and universities," Record Amer. Insl Acluor , Vol. 8(1919). pp. 202 -Of), 

33. "The effect of present inflated prices on the future interest rate," Rtciird .\mrr tnu. 

Aclmr., Vol. 8(1919), pp. 308-14. 

34 "On functional relations for which the eoeffieient of correlation is aero." Quarl Pub. 

Amer. /Slo(, Assn. September 1919, pp. 472-76. 

35. Exposition of the main provisions of the standard plan for a eotnbined cumprnhensive 
annuity and insurance system for public employees." IlliiuiiH IVnainn Lawat'om- 
mission Report, 1919, pp. 25-48. 

89. "Recent developments in pension legislation in other states of the 1‘nited Htstes," 
Illinois Pension Laws Commission Report, 1910, pp. 201-06. 

87, "The world’s experience in the operation of public service fiensioti systems," Illinnis 
Pension Commission Report, 1919, p 207-14. 

38. "Summary of the report of the Illinois Pension Ijiws Cummissinn of 1916," Ilhtuiis 
Pension Commission Report, 1019, pp. 216-22, 

30. "Etfects of the pension legislation by the fiftieth general nasembly of llliimi«," lUiniii* 
Pension Commission Report, 1010, pp, 223-34. 

40. "Rlinois state teachers' pension and retirement system, Illinois Pcnsiein C'ommiwion 

Report," 1919, pp. 235-38, 

41, "Industrial and institutional pension Byslems," Illinois Pension CVimtniasion licpurl, 

1919, pp, 239-50, 


42. Urn schemata as a basis for the development of correlation theorv." A unalu of Math 

Vol, 21(1920), pp. 306-22. ‘ 

43. "On certain properties of Makeham’s laws of mortality," Amer. Math Month Vnl 

27(1921), pp, 162-65. 

44. "Pension systemB for insurance company employees.” Record Amer. tmt. Aetuar 

Vol, 10(1921), pp, 1-14, ' 

45. "An elementary exposition of the theorem of Bernoulli with applicaliomi to atatmlica." 

Math. Teacher, Vol. 14(1921), pp. 427-34, 

46. Frequency distributions obtained by certain transformations of normallv distributed 

« < 0 , Annak Math., Vol. 22(1922), pp. 292-300. 

Statistics’in a Encyclopedic Dielionnry," Amer. .Math. .Mouth., Vol. 

pp, gSo-oo?, 

^ methcmaticnl statistics,” Presented before the 

nthematical Association of Amertcn at the Symposium held in Cambridge, Dec. 
_ 29, 1922, Amer. Math Month., Vol. 30(1923), pp, 165-100 

Un certain topics in the mathematical theory of statistics." symposium Lectures Imforo 
American Alathcmatical Society, Bull Amer. dfa(;,^Cvnl 30(^9^ pT 
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50. "On antuuty rates," Ifecorrf Amer Inst. Actuar ,yo\ 13(1924), pp 120-122, 

51. "On certain applicaliona of mathematical statistics to actuarial data,” Record Amer. 

Insl. Actuar., Vol. 13(1924), pp. 214-250. 

52. "On a certain law of probability of Laplace,” Proc. Internal, Math, Cong,, Toronto, 

Vol. 2(1924), pp. 795-799. 

63. "Note on average numbers of brothers and of sisters of the boys m families of N chil¬ 

dren,” Science, Vol 60(1924), pp. 46-47. 

64. "On the representation of a certain fundamental law of probability,” Trans, Amer, 

Math. Soc , Vol 27(t925), pp. 197-212, 

65. "On applications of statistical methods in actuarial science,” Record Amer. Inst. 

Actuar., Vol. 14(1925), pp. 102-04 

56. "Mathematical background for the study of statistics,” 11. L. Rietz and A. R. Cra- 
thorne. Jour. Amer. Slat. Assn., Vol 21(1926), pp. 435-440. 

67. "On certain applications of the differential and integral calculus in actuarial science,” 
Amer. Math. Month , Vol 33(1926), pp. 9-23 

68 "Note on the most probable number of deaths,” Record Amer. Insl. Actuar., Vol 
16(1927), pp. 26-29 

59. "On certain properties of frequency distributions of the powers and roots of the vanates 

of a given distribution,” Proc. Mai, Acad. Set., Vol. 13(1927), pp. 817-20. 

60. Discussion of "Interpolation with modified coefficients,” Record Amer. Insl Actuar., 

Vol. 16(1927), pp. 232-33. 

61. "On the risk problem from a mathematical point of view,” Neuoienne Congres Inter¬ 

national D'Actuaires, Rapports, Tome II, (1930), pp. 294-306. 

62 "Pensions tor superannuated employees,” Retiring vice-presidential address before 

Section K AAAS, Set. Month., March 1930, pp. 224-30. 

63 "On certain properties of frequency distributions obtained by a linear fractional trans¬ 

formation of the variates of a given distribution,” Annals of Math. Slat, Vol. 
2(1931), pp. 38-47 

64, "Note on the distribution of the standard deviation of sets of three variates drawn at 
random from a rectangular distnbution,” Biometnka, Vol. 23(1931), pp. 424-26. 
66 "Some remarks on mathematical statistics,” Retiring president's address before the 
Iowa Academy of Science, Science, Vol. 74(1931), pp. 1-4. 

66. “Comments on applications of recently developed theory of small samples,” /our. Amer. 

Slal Assn., Vol. 26(1931), pp. 37-44 

67. "A simple non-normal correlation surface,” Swmelrtka, Vol 24(1932), pp. 288-90. 

68. "Oil the Lexis theory and the analysis of Yariance,” Bull Amer. Math. Soc., Vol. 

27(1932), pp 731-35. 

69. "Unemployment and social insurance," Record Amer. Insl. Actuar., Vol. 23(1934), pp. 

147-52 

70. "On the frequency distribution of certain ratios," Annals of Math. Stal , Vol. 7(1936), 

pp 146-53. 

71. "Some topics in sampling theory," Bull Amer Math, Soc , Vol, 43(1937), pp. 209-30. 

72. "Collective insurance," Bull, Amer. Assn Univ. Prof., Vol. 23(1937), pp. 278-81. 

73. "On the distribution of the 'Student' ratio for small samples from certain non-normal 

cliatributiona,'' Annals Math. Slat., Vol. 10(1939), pp. 265-74. 

74. “On a recent advance in statistical inference,” Amer. Math, Month., Vol. 46(1938), 

pp. 149-68. 

Doctorate Dissertations Written Under the Supervision or Professob Rietz 

Reilly, John Franklin, 1921. On certain generalizations of osculatory interpolation. 
Weida, Frank M,, 1923. The valuation of life annuities with refund of an arbitrarily as¬ 
signed part of the purchase price. 

Smith, Clarence De WtlL, 1928. On generalized Tohebycheff inequalities m mathematical 
statistics. 
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Jl/eygr, Herbert A,, 1929. On certain inequalitipa with applicalioM in artuarial nence 
Craig, Alien Tkornion, 1931. On the dintribution of certain atatiatica derived /ffini fimnll 
random Bamplcs 

Wilts, Samuel Slanley, 1931. On the distribution of atatistirs in aamplM from n normnl 
population of two variablea with matehed aamplniR of one vanahlo 
Fischer, Carl H., 1032. On correlation aurfacea of buidb with a eertain number of randrim 
ekmenta in common. 

Harper, Fbyd S., 1935. An actuarial study of infant mortality. 

OUmr, Arthur, 1986. On certain mathmatienl developments underlying an analysis of 
general death rates. 

KnowUr, Lloyd A., 1037, Aetuarial aspects of recent old «ge security legialnlimi 
OUhen, Abraham C., 1937. TrnnaFormations of the I’earson type HI distribution, 

Berg, Wilham D., IWI. Theorems on certain type A difference cciuatitm gradu.ations. 
Salterthwaite, Franklin, 1941. Developments on the theory of Chi-square. 

Garfin, Louis, 1942, A comparative study of the underlying principles of certain pettsioii 
schemes for n staff of employees with special reference to U’aehera and public 
employees. 


The last two dissertations were under the joint BuiM-rvisioti of Professor lUets and Pro¬ 
fessor A. T. Craig. 


Books 


1, CclUge Algebra, H, L Rietc and A. R. Crathornc, First edition, 1000, Fourth eiUlimi, 

1939. Henry Holt and Company, New York. 

2. School Algebra, two volumes. H, L. Riet*, A. R. Crathornc, E. H. Taylor, 1015. Henry 

Holt and Company. 

3 Malhemalics of Finance, H. L. Riotz, A. R, Crathorne, J. C. Rict*. First edition 1021, 
second edition 1929, Henry Holt and Company. 

4. Introductory College Algebra. H, L. Riet* and A. R, Crathorne, First editiim 1923. 

second editioti 1933. Henry Holt and Company, 

5. Rondboofc of Malhenaiical Slalislm, H L, RieU, Editor-in-chief, 1924, Houghton 

MiflSin Company. 

6. Malhemtdical Slatutke. Third Carua Mathematical Monograph, published for thp 

Mathematical Association of America by the Ojien Court Publiahing (*o 1927, 

7. Remw of Pre-college Mathematics, C. J, I^app, F, B, Knight, H. L. Riet*, 1034. Scott, 

Foresman and Company. 

8. Plane Trigonometry, H, L, Riet*, J, F. Reilly, Roscoc Woods, 1935. The Macmillan 

Company. 

9 Plane and Spherical Trigonometry. H, L, Riet*, J. F, Reilly, Roscoe Woods, 1935. 
The Macmillan Company, 

10. Intermediate Algebra, II L Rietz, A. R. Crathorne, L. I Adams, 1042. Henry Holt 

and Company. 

11. Review of MalhemaUcs for College Students. C. J. Lapp, F. B. Knight, H. U RIeU, 

1942. Foresman and Company. 



NEWS AND NOTICES 


Readers are imiled to submit lo the Secretary of Die Institute 
nms items of general interest 

Personal Items 

Lt. Col. Jorieph Ikrkson is now stationed at Headquarters) Army Air Forces, 
.fHr Surgeon’s Office, Washington 25, D. C. 

Dr. Ernest E. Blanclie is now Statistical Director, Office of the Director of 
Engineering, wth the Curtiss-Wright Corporation at Buffalo. 

Dr. Alva E. Brandt is overseas serving as Operations Analyst for the Army 
Air Forces. 

Professor W. G. Cochran and Dr. A. M. Mood are serving as Research Mathe¬ 
maticians on a war research project at Princeton University. Professor Cochran 
is on leave of absence from Iowa State College; Dr. Mood from the University 
of Texas. 

Mr. Robert Dorfman is overseas serving as Operations Analyst with the 13th 
U. S. Air Force. 

Mr. R. M. Foster of Bell Telephone Laboratories has been appointed professor 
and head of the department of mathematics of the Polytechnic Institute of 
Brooklyn. 

Dr. Andrew I. Peterson is now Director of Manufactujing Research at the 
Victor Division of the Radio Corporation of America, Camden, N. J. 

Dr. Edward Helly, visiting lecturer at the Illinois Institute of Technology, died 
on November 28,1943. 

Professor Henry L. Rietz died on December 7, 1943 after a long period of 
illness. An account of Professor Rietz’ scientific life and achievements by 
Professor A. R. Crathome appears on pp. 102-108 of the present issue of the 
Annals. 


New Members 

The following persona have been elected to nvcmbership in the Institute' 

Allen, Boy George Douglas. D Sc. (London) Iteuder in Economic Statistics, University 
of London, Apt. 219, 2746 20th St, NW, Washington 8, D. C. 

Burk, Mrs. Marjorie F. A,11. (Hunter) Assoc. Statistician, Meteorology, HQ, AAP. 
1012 Third St NE, Washington 2, D. C. 

Churchman, C. West. PhD (Pennsylvania) llosoiirch Statistician, Prankford Arsenal; 
and I.ccturor in Philosophy, Uaiv. of Pennsylvania. Prankford Arsenal, Philadelphia, 
Pa. 

Crump, S, Leo, JLS. (Clorncll) llcsearch Associate, Iowa State College. Statistical Lab , 
Iowa State College, Ames, Iowa. 

DlvatU, M, V. M.A. (Columbia) Statistical Olhcer, Dept, of Industries and Civil Sup¬ 
plies, New Delhi, India, 

Freund, John E. B.A. (U.C.L.A.) Box 4221 Westwood Village Station, Los Angeles 24, 
Calif. 
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GUI, John P. Statistician, Dept, of Ilesearch anil Klatmtirs, Feileral lleifervi’ Hank, 
Dallas, Texas, 

Lindsey, Fred D. M.A. (CeorRo Waslnngton Univ ) 62K West 111 St , Xew Vork, X Y, 

Maloney, Clifford J. M.A,. (Minnesota) 2d l,t., Sir. C'. 153,* IHth St X , ArlinRUtn, Va 

Mandel, John. Licence en Sciences (Dniv. of Brussels) 15 Ken fi-ardeni lid , Kew 
Gardens, K. Y. 

Mathleus, George John, H.L. (Gniv of Dayton) Shop followup .Vewmldy I'lntmiiiR, 
Douglas, Long Bench. 1853 Poppy Ht., K. laing Beach, fnlif. 

McIntyre, Francis E. Ph.D. (Chicago) Program Officer, Porcigri Kronomic Adminmira- 
tion Rm. 2446 Temporary U Bldg., Washington 25, D, (’. 

Raybould, Ethel H. M.A. (Queensland) lascturar in Mathematics. Thi» I'nivcraity 
of Queensland, Brisbane, Australia, 

Rosenblatt, Alfred. Ph D. (Cracow) Catodratico dc la t'niveraidad de Kan Afarcoa, 
Lima. Calle Atahualpa 192, Mirafiores, Peru. 

Saunders, Robert J. B.S. (Mass. Inst, of Tech.) ('aptntn, Ordnance I>ept., Insfwtion 
See., Amm'n Branch, Office Chief of Ordnance. Office Field DireeUir Ammunition 
Plants, 3637 Lindoll Blvd , St. Louis 8, Missouri. 

Schwartz, David H. B S. (C.C.N.Y,) Asaoc. Statistician, Office of iW Quartermaster 
General. 338 N. Goo. Mason Dr., Arlington, Va. 

Solomons, Leonard M. B A. (Columbia) Time Study Man. lSU-11 HH Ave . Jamaica 2, 
N. Y. 

Steinberg, Joseph. BS (C.C.N.Y.) Associate Statistician, Bureau of Reacareli and 
Statistics, Social Security Board. 5041 North Capitol Street, Waaliingum H, D C. 

Tomlinaon, Malcolm C. W. 3820 Southern Ave., 8.E., Washington, D. C. 

Wilson, Edward F. Asst, Engineer, Special Projects. Bldg 650, Ttcscarch ('-enter. Alier- 
deen Proving Ground, Md. 


Announcements 


Washinglon Meeting of Oie Insliluk 

There tvill be a joint sectional meeting* of the Institute of Mathematical 
Statistics and the American Statistical Association at the Hotel Btatler and 
George Washington University in Wasliington, D, C., on Saturday and Rimdav 
May 6-7, 1944. ’ 

On Saturday afternoon there will be a session on the Theory of SUUUUcal Infer¬ 
ence mth Professor A. Wald and Lt. J. H. Curtiss as the speakers. On Sunday 
morning there will be a session on contributed papers and on Sunday after¬ 
noon a session will be devoted to Time Series with Professor J. L, Ooob and Dr. 
T. Koopmans as the speakers. 


Summer Meeting of the Institute 

The summer meeting of tlie Institute wll lie held in conjunction with the 
summer meetings of the American Mathematical Society and the Mathematical 
Wation of America at Wellesley College, Wellosloy, Massachuaetts, on 
August 12-14, 1944, Abstracts of contributed papers for this meeting should 
be sent (m duplicate) to the Secretary of the Institute before July 1, 1944. 


* The Washington meeting of the Institute had been announced in the December 
ssue of the AnnaU for April 27-28,1944, but the date has been revised to Mayt? in o^r 
that the meeting may be held jointly with the Association. ’ 
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ANNUAL REPORT OF THE PRESIDENT OF THE INSTITUTE 

During 1943, the second war year in which a regular annual meeting of the 
Institute was not held, the business of tlie Institute was necessarily largely con¬ 
ducted by mail. As reported in the March issue of the Annals, the vSecretary, 
the ICditor of the Annals, and I met in Pittsburgh in January for discussion of the 
Institute’s aflaii's. Since three memlicrs of the Board of Directors do not consti¬ 
tute a quorum, certain proposals arising from this informal meeting were sub¬ 
mitted by mail to the whole Board for action. At the fall meeting of the Institute 
held in New Bnmswick a quorum of the Board was present. Hotelling, Wald, 
Wilks, Craig, and action was taken on certain matters. Tlie chief subject for 
consideration was future meetings of the Institute. It was agreed that again in 
accordance wth the request of the O.D.T. no annual meeting should be planned 
for 1943. Because of the success of local meetings held in New York City in 
May and in Washington in June, it was voted to repeat these in 1944. The New 
Brunswick meeting w'as also very successful, and it is hoped that we may again 
hold our fall meeting in conjunction wth those of the American Mathematical 
Society and the Mathematical Association of America in 1944, The desirability 
of other local meetings in addition to those in New York and Washington was 
recognized but, so far, I know of no plans for any in 1944. 

During the year two local chaptera of the Institute were organized in Pittsburgh 
and Washington in accordance with regulations adopted by the Board of Direc¬ 
tors, and these were recognized by the Board. The sponsor for the Pittsburgh 
group is E. G. Olds, and W. G. Madow has the same responsibility for the 
Washington chapter. 

The Membership Committee for 1943 consisted of Vice-President Deming, 
Chairman, W. G. Cochran, P. S. Dwyer, and A. J. Lotka. As the result of their 
recommendation the following eighteen new Fellows of the Institute were elected 
by the Board of Directors: A. H. Copeland, J. H. Curtiss, J. F. Daly, C. E. Dieule- 
fait, H. F. Dodge, Churchill Eisenhart, Will Feller, Milton Friedman, M. A. 
Girschick, M. H. Hansen, P. G, Hoel, Tjalling Koopmane, A. M. Mood, L. J. 
Reed, L. E. Simon, F. F. Stephan, W. R. Thompson, and Jacob Wolfowitz. 

W. D. Baten, L. A. Aioian, I. W. Burr, and H. F. Dodge, at the request of the 
Board, continued to serve as a committee for securing additional library subscrip¬ 
tions to the Annals, Programs for the New York and Now Brunswick meetings 
were in charge of Vice-President Wald, and that for the Washington meeting was 
arranged by W. G. Madow. 

A proposal originating with Harold IloteUing that the Institute consider peti¬ 
tioning the Federal Government that the W. P. A. Computing Project be made a 
permanent computing group for the service of scientific research in the construc¬ 
tion of important numerical tables, was referred to a committee consisting of 
A. R. Crathome, Chairman, P. S. Dwyer, and Will Feller. As a result of their 
report, the Board appointed the following permanent committee on tabular 
computation, P. S. Dwyer, Chairman, Churchill Eisenhart, and Will Feller. It 
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is expected that this committee will cooperate with rcprc^ntJitivw of uther 
scientific organizations interested m tabular computation. 

The Nominating Committee for the recentlj'- held elet'lioit of the Inatitute was 
A T, Craig, Chairman, B. H, Camp, and J. H, Chirtia-'i. 0. W, Snerlmir served 
the Institute as its representative on the Council of the American Awoeiation for 
the Advancement of Science. 

To all of those mentioned the Institute is indebted, and for the HtMittl of I tiree- 
tors I wsh to thank them for their sficcial contrilnitions to the Institute. 

I have reserved tor particular mention the services of Vice-l’resident- Ueiniivg 
who was appointed by the Board the official representative of the Institute to deal 
with officials of the Selective Service Board in Waphinglon rtdalive to the defer¬ 
ment from military service of competent and experienced stali.stieians engaged 
m Work important for the prosecution of the war. He gave much time and efTort 
to this on his own initiative, and the Institute and alt stati.stieians owe him much 
in that he has been very successful in convincing important Washington officials 
of the value of the services lieing rendered by good statisticians. 

In December the Board with deep regret accepted the resignation of E. G, Olda 
who was completing hia third year as Secretary of the Institute. No memlnw of 
the Institute will need to be reminded of the devotion and efficiency with which 
he filled his office. A mere comparative inspection of his annual reports would 
reveal to anyone otherwise uninformed how much the Institute owes (« him. 
During his term of office the membership of the Institute has approximately’ 
doubled and the financial position of the Institute has Ixjcn markedly improvecl 
in. spite of war conditions. For both of these favorable circunwitaucea he de¬ 
serves the greater part of the credit. In hia present position as C’hief Statistical 
Consultant mth the Office of Production Eesenreh and Development of the 
War Production Board in association with Holbrook Working, he. is still wn*- 
ing the cause of statistics as well as the war effort. Tlie Institute will greatly 
benefit by the intensive work these men are doing in educating industry in the 
uses of statistical methods in the control of quality in production. 

The annual election of the Institute just concluded by mail resulted in live elec¬ 
tion of ffie Mowing officers for 1944; W. A. Shewhart, President; ^\^ G, Cochran 
and Will Feller, Vice-Presidents; and P. S. Dwyer, Secretary-Treasurer. Pro¬ 
fessor Dwyer had been appointed Acting Secretary-Treasurer upon the resigna¬ 
tion of Professor Olds. I need not remind the members of the Institute that the 
year 1944 remains critical for the Institute and that these new officera will need 
the fullest support. 

C. C. CoAta, 

Pr$8idml, 19 j}S. 


February 15,1944, 
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ANNUAL REPORT OF THE SECRETARY-TREASURER OF THE 

INSTITUTE 

During 1943 three meetings of the Institute were held. On May 29, the In.sli- 
tute met jointly with llie American Society of Mechanical Engineers at the 
Engineering Societies Building in New York City, the program having been 
arranged by Abraham Wald and A. I. Peterson. A meeting consisting of three 
evening sessions was held on June 17-19, at George Washington University, 
Washington, U. C. William G. Madow made the necessary preparations for tliis 
meeting. On September 12-13, the Institute held its sixth summer meeting at 
New Jersey College for Women, Rutgers University, New Brunswick, New 
Jersey. This meeting was held in conjunction with the summer meetings of the 
American Mathematical Society and the Mathematical Association of America, 
and the program was arranged by Abraham Wald. All three of these meetings 
were well attended. 

Early in the year a petition was gianted for the establisliment of a Pittsburgh 
Chapter of tlic Institute. This organization, formerly known as the Society 
of Quality Control Statisticians, held its fiist meeting under the auspices of the 
Institute on June 19, and a second meeting was held on October 9. 

As recorded in an addendum to last year’s report, Vice-President E. L. Dodd 
died on January 9, 1943, and Dr. W. E. Deming was appointed to fill out the 
uncxpired term. 

Professor H. L. Rietz died on December 7,1943. A statement of appreciation 
for his work in mathematical statistics and in connection with the Institute has 
been prepared by Professor A. R. Crathorne and appears in the present issue 
of the Annals. 

The following financial statement covers a period from December 10, 1942, to 
December 21, 1943 (the books and records of the Treasurer have been audited 
by Paul S. Dwyer and found to be in agreement with the statement as sub¬ 
mitted) : 


FINANCIAL STATE.MENT 
December 10, 1942, to Dcccinbcr 21, 1943 
Receii’ts 


Balance on Hand, December 10, 1042. 12,166.13 

Dues . 2,640.62 

SuBSCiumoNB. 1,631.67 

Sales oe Back Numbers. 901.47 

Miscellaneous. 6.07 


Total Receipts 


$7,334.96 
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KxPk.NDITUIW:B 

ANKAi-aOri'icC. . . ... W 2fi 

Waverly Press 

Printing and Miiiling jlnna/s—4 issues. . ... S.Tfi.I 2R 

Back Numbers Oepicb 

Purchase of back numbers from If, C. Carver . , , 8171 W 

Keprinting 200 copies of Vol. Vn, No. 1. ..... . lOH.fW 

279 «M 

Library Committee. 36.11 

Secbbtary-Treasurer’s OrfiOE 

Printing and Supplies. 8136.tX) 

Binding . 2.26 

Postage . 136.77 

Clerical Help . 171.20 

•144.22 

Proqrams FOR Meetinos. . , , . 44 22 

Board OF Directors . . 41.74 

Miscbelaneous. , SA5 

Total Expenditures . . M,619 ill 

Bai.ance ON Hano, December 21, 1943 . . 3,716.05 


»7,33-1.96 

In compari.wn with the financial condition of the Institute at the end of lfl42, 
tlie receipts from dues and subscriptions have increased nearly $700 and the 
proceeds from sales of back numbera have decreased nearly $600. In spiU' of 
increased prices, it was possible to reduce expenditures by approximately $H0O. 
Thus the In.stitute finds itself in a somewhat more favorable position than at tho 
end of last year. 

Edwin C. Olds, 
Scdrefariz-Treimirer, 

December 27, 1943. 


coNSTrrirnoN 

OF THE 

INSTITUTE OF MATHEMATICAL STATISTICS 

ARTICLE I 
Namb and PuarosB 

1. This organisation shall be known as the Institute of Mathemntloal Statistics. 

2. Its object shall be to promote the interests of mathematical statlatios. 

ARTICLE II 
Mxicbbrsbif 

1. The iMmbeiship of the Institute shall consist of Members, Junior Members, Fellows, 
Honorary Members, and Sustaining Members. 
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2. Voting merabpt^ of the Institute shall be (a) the Fellows, and (b) all others, Junior 
Membera excepted, who have been members for twenty-three months prior to the date of 
voting. 

3. No jrerBon shall be a Junior Member of the Institute for more than a limited term as 
determined by the Committee on Membership and approved by the Board of Directors. 

ARTICLE III 

Opficeus, Boahd of DiRECTona, and Committee on Membehship 

1. The Officers of the Institute shall be a President, two Vice-Presidents, and a Secre¬ 
tary-Treasurer. The terms of office of the President and Vice-Presidents shall be one year 
and that of the Secretary-Treasurer three years. Elections shall be by majority ballots at 
Annual Meeting.s of the Institute. Voting may be in person or by mail. 

(a) Exception. The first group of Officers shall be elected by a majority vote of the in¬ 
dividuals present at tlie organization meeting, and shall serve until December 31, 1936. 

2. The Board of Directors of the Institute shall consist of the Officers, the two previous 
Presidents, and the Editor of the Official Journal of the Institute. 

3. The Institute shall have a Committee on Membership composed of three Fellows, 
At their first meeting subsequent to the adoption of tliis Constitution, the Board of Di¬ 
rectors shall elect three members as Fellows to serve as the Committee on Membership, 
one member of the Committee for a term of one year, another for a term of two years, 
and another for a term of three years. Thereafter the lloard of Directors shall elect from 
among the Fellows one member annually at their first meeting after their election for a 
term of three years. The president shall designate one of the Vice-Presidents os Chairman 
of this Committee. 


ARTICLE IV 
Meetings 

1. A meeting for the presentation and discussion of papers, for the election of Officers, 
and for the transaetion of other business of the Institute shall be held annually at such 
time as the Board of Directors may designate Additional meetings may be called from 
time to time by the Board of Directors and shall be called at any time by the President 
upon written request from ten Fellows. Notice of the time and place of meeting shall be 
given to the membership by the Secretary-Treasurer at least thirty days prior to the date 
set for the meeting All meetings except executive sessions shall bo open to the public. 
Only papers accepted by a Program Committee appointed by the President may be pre¬ 
sented to the Institute 

2. The Board of Directors shall hold a meeting immediately after their election and 
again immediately before the expiration of their term. Other meetings of the Board may 
be held from time to time at the call of the President or any two members of the Board, 
Notice of each meeting of the Board, other than the two regular meetings, together with a 
statement of the business to be lirougbt before the meeting, must be given to the members 
of the Board by the Secretary-Treasurer at least five days prior to the date set therefor. 
Should other business be passed upon, any member of the Board shall have the right to 
reopen the question at the next meeting. 
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3. The Committee on Mcmberelup shall hohl a meeting immeiliaU'ly after the anmml 
meeting of the Institute. Further meetings ot the CnmmitU,‘e may l>e held fmm tune U» 
time at the call of the Chairman or any memlrcr of the Committw pnmiied nntic*' of «ueh 
call and the purpose of the meeting is given to the memlwre of the Committee liy the 
Secretary-Treasurer at lea.st five days before the date set tberefor. Khctuhl other 

be passed upon, any member of tlic Committee shall have the right to rt^ipeii the qnestion 
at the next meeting 

4. At a regularly convened meeting of the Hoard of Directors, four memlierf* shall con¬ 
stitute a quorum At a regularly convened nieeting of the Committee on Meml«>n>bi[i, 
two members shall constitute a quorum. 

ARTICU3 V 

PunUCATIONS 

1. The Anneds of Mo^homaiical SlcUitlics shall he the Official Journal for the Institute. 
The Editor of the Annala of Malhemalical Ruuislics shall l>e a Fellow appointed hy the 
Board of Directors of the Institute. The term of office of the Editor may lie lermimitrHl at 
the discretion of the Board of Directors. 

2. Other publications may be originated by the Board of Directors a,s ormusion arisca. 

ARTICLE VI 
ExPUWtONf on SUBPKNSIOX 

1 Except for non-payment ot dues, no one sluvU be expelled or sufliwcidcd except by 
action of the Board of Directors with not more than one negativ» vote. 

ARTICLE VII 

AMEMDUENTa 

1. This constitution may be omonded by an affirmative two-thirds vote at any regularly 
convened meeting of the Institute provided notice ol such proposed amendment shall have 
been sent to each voting member by the Secretary-Treasurer at least thirty day* before the 
date of the meeting at which the proposal is to be acted upon. Voting may be iit peraon or 
by mail. 


BY-LAWS 

ARTICLE I 

Duties of the Officeks, the Editor, Board of Directors, and Comsuttbe ok Mkm- 

BER8HIP 

1. The President, or in his absence, one of the Vice-Presidents, or in the absence of the 
President and both Vice-Presidents, a Fellow selected by vote of the Pello wa pr«ent, sludl 
preside at the meetings of the Institute and of the Board of Directors. At mootings of the 
Institute, the presiding officer shall vote only in the cose of a tie, but at meetings of the 
Board of Directors he may vote in all cases. At least throe months before the date of the 
annual meeting, the President shall appoint a Nominating Committee of three momliere, 
It shall be the duty of the Nominating Committee to make nominations for Officers to be 
elected at the annual meeting and the Secretary-Treasurer shall notify all votirig members 
at least thirty days before the annual meeting. Additional nominations may be sub- 
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mitted in writing, if signed by at least ten Fellows of the Institute, up to the time of the 
meeting. 

2. The Secretary-Treasurer shall keep a full and accurate record of the proceedings at 
the meetings of the Institute and of the Board of Directors, send out calls for said meetings 
and, with the approval of the President and the Board, carry on the correspondence of the 
Institute. Subject to the direction of the Board, he shall have charge of the archives and 
other tangible and intangible property of the Institute, and once a year he shall publish in 
the Annals of Mathematical SlcUislics a classified list of all Members and Follows of the 
Institute. He sliall send out calls for annual dues and acknowledge receipt of same; pay 
all biUs approved by the President for expenditures authorized by the Board or the Insti¬ 
tute; keep a detailed account of all receipts and expenditures, prepare a financial statement 
at the end of each year and present an abstract of the same at the annual meeting of the 
Institute after it has been audited by a Member or Fellow of the Institute appointed by the 
President as Auditor. The Auditor shall report to the President. 

3. Subject to the direction of the Board, the Editor shall be charged with the responsi¬ 
bility for all editorial matters concerning the editing of the Annals of Mathematical Sta¬ 
tistics. He shall, with the advice and consent of the Board, appoint an Editorial Commit¬ 
tee of not less than twelve members to co-operate with him; four for a period of five years, 
four for a period of three years, and the remaining members for a period of two years, ap¬ 
pointments to be made annually as needed. All appointments to the Editorial Com¬ 
mittee shall terminate with the appointment of a new Editor. The Editor shall serve as 
editorial adviser in the publication of all scientific monographs and pamphlets authorized 
by the Board. 

4. The Board of Directors shall have charge of the funds and of the affairs of the In¬ 
stitute, with the exception of those affairs specifically assigned to the President or to the 
Committee on Membership. The Board shall have authority to fill all vacancies ad in¬ 
terim, occurring among the Officers, Board of Directors, or in any of the Committees. The 
Board may appoint such other committees as may be required from time to time to carry 
on the affairs of the Institute. 

5. The Committee on Membership shall prepare and make available through the Secre¬ 
tary-Treasurer an announcement indicating the qualifications requisite for the different 
grades of membership. 

ARTICLE II 
Dues 

Members shall pay five dollars at the time of admission to membership and shall receive 
the full current volume of the Official Journal. Thereafter, Members shall pay five dol¬ 
lars annual dues The annual dues o f Junior Members shall be two dollars and fifty cents, 

The annual dues of Fellows shall be five dollars. The annual dues of Sustaining Members 
shall be fiity dollars Honorary Members shall be exempt from all dues. 

(a) Exception. Ih the case that two Members of the lostituto are husband and wife 
and they elect to receive between them only one copy of the Official Journal, the annual 
dues of each shall be three dollars and seventy-five cents. 

2. Annual dues shall be payable on the first day of January of each year. 

3. The annual dues of a Fellow, Member,or Junior Member include a subscription to the 
Official Journal. The annual dues of a Sustaining Member include two subscriptioas to 
the Official Jo.umal. 

4. It shall be the duty of the Secretary-Treasurer to notify by mail anyone whose dues 
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may be six months in arrears, and to arentnpany sueli nnlire iiy a ropy of tin*, Article, If 
such person fail to pay sucli dues within three moiitlis from the date of inailinR siieh noln e, 
the Secretary-Treasurer shall reiKirt the dplinf)uent one to the Ikiard of 1 lireefors, by whom 
the person's name may he .stricken from the rolls and all privilPij;M of mernltership with¬ 
drawn Such person tnay, however, be rc-insfated hy the Board of I)ire<'tfir.‘< ofmn pay¬ 
ment of the arrears of dues. 


ARTICLE nr 

Balabieh 

1. The Institute shall not [lay a salary to any Oflicer, Director, or iiietnlMT of imy nmi- 
mittee. 

ARTICLE IV 
Amendments 

1. These By-Laws may be amended in the same manner as the CoiiRtitution or hy a 
majority vote at any regularly convened meeting of the Institute, if the propo.ted .arnenrl- 
ment has been previously approved by the Board of iJirpetors, 



FURTHER CONTRIBUTIONS TO THE PROBLEM OF SERIAL 

CORRELATION 


By Wilpmd J. Dixon 
Princeton Unweraihj 


1. Introduction. Rc'ccnlly, tlioro hti.s iK'fiii an incrnaHuin interest m tlie study 
of tlie serial correlation of ohservations. The dovelopment of the distribution 
theory and significance criteria was retarded by the fact that the successive dif¬ 
ferences or successive prodviota of statistical variates are not independent. IIow- 
e\'er, these diflioulties have been overcome to a considerable extent by recent woik 
of several authors. In order to indicate the nature of the cnntributioii.s (>ml)odied 
in the present paper, it will be noce.ssary to de.scribc rather precisely the eoiitri- 
Initions of these authoi'S 

)Suppose .ri, rj, • ■ - , x„ are n independent observations of a random variable 
X which is normally distributed with mean a and variance c". fiot u.s define 


(1.1) 


E (x.+l - X.)' 

= E (XO 

1-1 - X()' 

rt— 1 

Yj ' 'r)(iC(4.i ■” *0 

1-1 

c„ = E (xi 

- .X)(x^ 


iCn = 2 - x) 


T«s«l 


Un = E (-Ti - Xf 


i“l 


in which = Xi. The ratio of any of the first five values to F„ will lic' a 
measure of the relation between the successive olxservations .x,. 

Von Neumann [2] has studied the ratio rj = . lie obtain,s an expre.s- 

sion for the sampling distribution of the ratio t? He solve.s the equivalent prob- 

lein of determining the distribution of Yj 'where the point (yi, 2 / 2 , ■ , 

1-1 

n—I 

is uniformly distiibuted over the spherical .surface E = 1 the A; are tlvc 

I—I 

m 

charaeferistic values of sEi • He obtain.s the di.stribution uiy) of 7 = E 

1 ISjI 

(m even) wheie the point (.Vi, xj, ■ • , x„) is uiiifonnly distrilniied over fhe 

7». 

spherical surface E xi == 1 and lh> lh> ■ • • > P,,, ■ u(y) is found liy solving 
the equation 

( 1 . 2 ) r (t - 2 )"*’" 0 .( 7 ) dy = 11 (R. - ^)"^ 

Jb„ ,~i 

The distribution of v is then a .special case of this di.stribution. The first four 
moments were obtained by William.s [5] by the use of a generating function. In 
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the preweiit paper we shall stuch' the ratio sl, . The inuinfiif- of lliis ratio 
will be developed and the moments ami apiu-oxiinatcdistiibntiniiof |‘2 

Von Neumann [4] in a paper which removed a re.stnetion (that »« tn- even! 
on the distrilnition of ij iudicatcH how to de.terJiune the distribution of ( \ j IT . 
Koopmans [9] considers the stocha-stical process j-, ~ p.r, i ■]- -• 1. 2. • ■), 

I/> I < 1. The Z( are independent drawings from a normal disfrilmfiou with 
zero mean and varuvnee o-'’. To teat the hyjutthesis that p - <1 he ‘•huws that it 
is sufficient to know the distrilmtion of i.'IT . He lituis tlie tlistnbution of 
Cn-i/Vn and CJVn but finds that the rnunerienl eomjmtatiitu of tlu'st* futuhions 
is very cum))eisonu‘. This prompts him to (fiifain ap|)rr(xitnate formnhw for 
these distributions, The approximate formula for the distribution of f ~- 
C„/Fn is 

(1 3) (in — 1)2*" / (co.s a — f)*"‘' sin ain tf dru 

JO 

A similar approximation will be used in this paper to find the luoinents of 
Cn/Vn . It will be shown how Rood the approximation i.a and how by iiahiR Ihia 
approximation we may obtain a tabled funetion (Pearson Type li whieh fits the 
distribution of 1 — (CJVnf up to in niom(Uit«. 

The quantity 1 - (C„/V„)‘, we shall find, is ccpiivalent to a likelihood ratio 
function for testing the hypothesis that the serial correlatiou is Z(*ro, 

Anderson [8] obtained the distribution of « i.R„ . He proved that the 

distribution of tRn is the same as that of \li„ when L and n are primt* ttj eaeh 
other. Ho has computed the 1 per cent and 5 per cent siRniheaiice values 
(L = 1) up to n = 75. For values of u > 75 he indicates that a normal tUntribu- 
tion which is an asymptotic approximation may be used. He has also eoinputed 
some significance values for the cases of iV/L == 2, 3, 4. 

In this paper we shall develop the moments of Jin ■ 

The use of the ratio n in the study of serial effects in ballistics at Aberdeen 
Proving Ground is given in references [1] and [2]. The use of the ratios f-T-i/V, 
and CjVn in the study of economic time series is discussed by Koopnmna [9]. 


2. Likelihood criteria. Given a sample of n observatioiuj Xi, , ■ • • , 

we shall assume that they are distributed according to the law; 


( 2 . 1 ) 



(1 < ^ n). 


It will be convenient to use the phraseology that "the variate at the time a has 
as its mean value a linear function of the variate at the time a - IJ We shall 
take X, = x„+,. Due to the symmetry we may use a + f in place of a — L 
This will be done to obtain agreement with previous work. We wash to test 
the hypothesis Hi that each variate is independent of the other variates, that is, 
that 5 = 0. The Neyman-Pearson specification of Hi may be written as follows, 
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'Where n is the .spare of admis-sihle viiluea of tr*, a luid h, and oj the .suhspa<'e de¬ 
fining f/i : 


(2 2 ) 


I il\ cf‘ > 0 - '-e < a, It < -r. 

1 w: (r“ > 0 - --t < a < >-, h ~ (I. 


The likelihocKl eritenou \i Huitahle to thia hypothesis is the ratio of tlu; inaxitnnm 
(w (max.)) of (2,1) with the restriction tlnit h 0 to the niaxinnnn (£1 (max.)) 
of (2.1) witlioiit tliis condition. Xow, 


(2.3) 


dP„(to max) 
dP„(Q max) ‘ 


We see that the likelihood function is 


(2.4) 


L ~ —a log (■\/2irer) ^ ^ (a-a — a - h.r„,t)^ 

Z<7' o-l 


and to maximize L over the space ft we compute the. following derivatives 


dL 

da 



a — 


(2.5) 


a 5Xa};)x«t^;, 


dL 1 
db ~ ? 

dL n , 1 . 

= + 


The solutions of the equations obtained by setting the. above derivatives equal 
to zero are: 


1 - d- !>xa+,y 

n 

(2.6) d = - Xzail - h) 

n 

^ _ TiijXtx iTa+I (2/Xa) 

If we now maximize L over the space oj we obtain 


(2.7) 


'a = - 2J(a:« - Cif 
n 

d = ^ 2;a;„ 


so that we will have 

(2.8) dP„(ft max) = [2x(l - 5')2(x„ - .f)"j 

(2.9) dP„(co max) = [2,r2)(x„ - x)']"*"^-*", 

(2.10) Xi = (1 - hy\ 
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where b is defined as iii (2fiJ uijovi*. If we set a ~ 0 in <2.1 1 wn in»y fullow a 
■similar procedure and find the (•riferinn oAi - fl — ^>1)^'' for te.stinjf the h,viiitth(',‘<iH 
that h = 0 if it is known that tht‘ pnpuhitiori mean injual zero. Hero 


( 2 . 11 ) 


bo 


I 4 Ca » / 




We notice that b is llic cnlerioii cIiomui by U. 1.. AmUTi-nii as a iimaMirf nf 
serial c.orrelatioii. Hi* has ulitaiiietl the distrihiitinn of h and has fiisn)»n1ed a 
number of Higmticance vidues from llii.s distrihiilinu. The distrihutitai is a 
function of n and I, and Anderson points out that the luiKcr the value.'' nf u the 
smaller the extent to which the sigtiifieaiiee values depeml oil 1. 

In the next section ue .shall liiitl a dislrihiition which apprnviiiuifes very 
closely the exact dLstrilmthm of b and which is iiidi'pendeiit of the lag 1. 


3. Moments of the likelihood criteria. We .shall dedTinine the inomcnls of 
bo and 0 X 1 when the hypothesis Jh Ls tuie and the moments of h and Xj when the 
hypothe.sis H\ is true. Let us (ii-st eon.sider !»« -- i2.r„r,.,/ , the eriterinn we 

obtained for te.sting thi' lt\-pothe.si.s olh ■ The inoinent genet atiiiK funelion for 
the joint distriliutioii of f'o — ^.raXun/cr' and Tn iV?, V' i.s 


(fi(h, li) — /!<’[(‘.\'p (Cod + {'’ofs)! 


(3.1) 


'( vD '£- 





By leleronce to this lust expression it can he seen that 
(3 2) AXio) =/“ dU, 

Oil 

and further 
(3 3) 


mt) 


'<-<0 J dll Jti'-o >-t 


in which we set ti = 

jml 

Now if we write (3,1) as follows: 


(3.4) 


( vL ,)'/:-/ 


II tic., 


we see that ip(ti, Ca) = j A,j j and A.u == ; that is, this deterniiiianl ia 

a circulant. T.et us write A,, ~ an where h etiual j — i -f 1 or j — t + 1 T /t 
taking that subscript which gives I < h < n, so that we liave 


ai 

Oj 

fla • ■ • 

On 

Ota 

ai 

02 ■ • ■ 

thi-l 

02 

<13 

04 • ’ ■ 

Ol 


(3.5) 


¥> '(ti, h) = 
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which expanded by the metiiod of ciroulants becomes 

A;»l t—1 

where the < 0 /, are the /ith roots of unity. 

Fir.st we shall consider ho (lap; 1). Here Ui = 1 — 2i:, = a„ = —ly and as 

to a, 1-1 equal zero. 


(3.1)) 


Oi^l {ly, t>) = n(i — 2/2 — iiictjji 4 " 

For lag Z, ai = 1 — 2<j, ai+i = a„_ivi = ~ty and the remaining a’s = 0. 

n 

ov’l '(^1 1 hy) = U(1 — 2(2 — ti(m + ')) 

(3 7) 


= n (1 - 2I2 - 2 iy cos 
A -1 \ n / 

We shall develop an approximation to these funct ions (3.G) and (3.7) as follows: 


, 1 “S W iM-fJ COH Ofjf) 

(3.8) aipi(h) h>) = n (-^ d" “») ^ = c , 

k-^i 

where in this case /I = 1 ~ 2k, B = — 2h and oa = 2vlh/n. Let us now alter 
the form of this exponent and replace, the sum of a Imite number of terms in¬ 
volving aK by an integral of a continuous Aniruible a. 


(3.9) 


BViiiy, k) = exp (- -- — I 0 & (*1 + eos aS) ■ 

\4:Trl n / 


~n 2x1 
, 4:xl n 

Let us write 2xl/n = , then we shall have 

' —n 


(3.10) 


uv?i(h, ifi) = exp ^ log {A -\r B 00 s on)i:ia^ 


If we take 7f < A we see that A + B cos (xk is never negative; therefore as 
we let n increase the summation will approach the value of the integral; 

rM 

/ log (A -f- B cos ft) da . Ijet us then replace this summation by its limiting 
Jo 

integral. The resulting function will then be an approximation for n large 
enough. We shall obtain then 


(3.11) 


ov?i(h) fa) 


exp J log (.1 + B cos a) B < A, 


from which by the use of the integral^ we obtain 

(3.12) oipi(h, k) ~ exp (—In log |(A + •y/A'^ — B^)) 


^ This integral may be verified by differentiation with respect to the parninctei n It 
may be found as formula 523 in Pierce’s “Short Table of Integrals ’’ 



]24 


wii.nfiti . 1 . nixov 


So that 

(3.13) o^i(h, /=) - l](A + x/.l- - /l^)! 


We now have , (») represi'nted iipprc innately hy ajinwei' of a.siiip;l(‘ tjuanfity. 
The question of how gucKl this approxinialioii i.« will Ut* (ii.KCUSr^wi in a later 
paragraph. This i.s similar to the approKimaticm used hv T. l\.iHi]iinaiis in the 
distribution of bo. He makes the auhstitutiim "to obtain w*hat infuitividy wanna 

T 

to he in .some sense the clo.se.st approxinuiliori." Ih’approximates JI (h h,j * 

where iti = eos --- by the jiroeeas followed in (3.8)~{3.1.H) in onler to fiml the 

distribution given m (1.3). 

To obtain the corresponding function for 


(3.14) 


(«.r«) /u 
I'al - (i;x„)Va ' 


w'e follow the same procedure lus above for bo . Iltn'i^ 


(' = — (i:j;„)Va]/(r*, 

V = - (2:a-,)Va)/^*, 


and in (3.5) Oi — 1 — 2b + 2(ti -f- h)/n', (is — a« — —fi -I- 2(fj + b) '’a; and all 
the other a’s = 2(b + b)/n so that the expansion of this eirculant becomes 


h) 

(3.15) 


and since 


n - 2b + 2(b + b)/«) + [-b + 2(b }- b)/nl(wi -t- «*’) 

+ [2(b + b)/n| ^ Wi' 


V + w*’ + I) k n, 

<“■8 1 ft o “ n, 

we get 

(3.16) {1 — 2b — b(ti>* + wi')|, 

and for lag I we get 


(3 17) 


n —1 


n (1 2b “ hitcl + ojjJ**)). 

k-X 


These two results arc the same as those obtained proviou.sly except that the, 
final terra, 1 - 2b - 2b = d. + B, of the products is missing. We. will then 
obtain as an approximation to these finite products tpT ~ xfpx^/{A + B) or 

‘Pk[h , b) = [4(d + ^/A- — !P)r*'’V'd~+"B 
where A = 1 - 2b and 5 = -2b . 
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A method of finding the moments of bo and b was outlined m (3.1), (3 2) and 
(3.3) above. If we perform these opeiations on o<pi(h, h) as defined m (3.13) 
we find 

Oi,Jl — u 


(3.19) 


oil 




dh 



du —2 

where n |o = 1 — 2 ^ 2 , — = 0 , --i , = ,- 7:7 , etc , and the zero subscript 

oil 0 dll 10 i — M2 

indicates that h has been set equal to zero after differentiation. If these values 
are substituted and the required number of integrations with lespcct to k are 
performed, we find the moments of the criterion bo when oHi is true 


(3.20) 


Ml = 0 i¥2 = 

n + 2 

_ __3__ 

¥3 = 0 ¥4 = 

__15_ 

d/s = 0 ilfo = 

etc., or 

*¥ 24-1 = 0 


M = l’3-5 • (2fc - 1)_ 

(n + 2)(n + 4) •.. (u + 2k)' 

Mik may be verified by the use of an expansion of the generating function (3.13) 
by a method of Laplace [10]. He gives the expansion of vT' where u is given by 
the equation 11 ^ — 2w + = 0 as follows; 

_ 1 . -|- 3 ) 0 “ , iii + 4)(i + 5)e® 

^ “ 2* 2^= 1.2-2’+^' 1.2-3-2'+'(i 


, iii + k + 1) {i+2k- l)e“* 

ik- i)! . ■ ■ 

We see that u = 1 + “s/l — and if we set e = h /(^ — /a) and z ~ ^n. We 
obtain oipi = u”*" as a series in the even powers of U . From this we can see that 
the odd moments arc zero and from the form of the coefficients we can verify 

¥24 . 

These moments are not contained in the works of the other authors writing 
on this subject. Although these moments are obtained from an approximate 
generating function they are, as will be shown later, the exact, not approximate, 
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momenta for k < n, foi lap; I lUitl nre 11m exact momenta for k •' n/a fi ir any lag 
I ■where a is the largest common factor of it tuul the lag /. 

To obtain the. momenta of fi we follow a aimilar i>roceiliue with 
ipi = ^'^”(1 - 2ti - 2h)K 1 )iff(‘ri'ritiatiiig the rettuinsl nninUer of fiinea with 
respect to h and integrating an cipud munher of tiniea with leapt-ct to ij gives the 
following moments; 


(3,21) 




ji - 1 


Mi 


1 

n t- 1 




-3 

(a - l)(n + 3) 


- 1 /. 


(n + 1)(« -1- 31 


-1.3.5 ... (2/.-- 1) 

~ (a - n(a H- 3)(u + 5) ■ • • (a f 2k - 1) 


1.3.5 ... ( 2 fc - 1 ) 

"" (n+ !)(;< +3) ••• (n h 2k - 1)' 

Examination of the momenta of bo will show that bo -- .r ia dialrilmlerl aecorrl- 
ing to the law 

(3 22 ) /i'i(l - , 1 ;"')'''““ - A\(] + .r;)“"'’'(l ■ ” 


up to n momenta. This diatrihntiou i.s symmetric, ami w(‘ may wi.sli a norinttl 
approximation to this curve. The mean is zero and th(' variance ia 1 /(h -f 2). 
The X criterion oXV" = (1 ~ (iii) = 2 / is distrilnitcd necuirding to the law 

(3.23) KiO ~ 


up to in moments. Here themean is "I"- ^ and the variance is , 7^!!.-2 ^ ? ... 

a+ 2 («-b 2) (k H 4) 

If we inspect the moments cd f> we sec that the distribution of X?^" ~ (I — ?/) — r 

follows the law 


(3.24) 


K:a(i - z)--y‘"-“' 


up to 511 momenta, which is the same as the distribution immediately pnnsHling 
except that n is replaced by /i - 1 . The di.sfcnbutinns (3.22), (3.2.3), ami (3.24) 
arc the same for lag I except that the fit is up to >i/a, n/2a, and )i/2a moments 
respectively where a is the largest common, factor of I and n. Thew rest rictions 
are necessary since the moments as given in (3.20) and (3.21) am obtained from 
the approximate generating functions (3.13) and (3.18). The exact generating 
function is given in (4,8) for lag I and it is found that the ath or higher deriva¬ 
tives bring contributions from the part of the generating function which was 
neglected m approximatmg the generating function. The additional restriction 
for lag I 1 will be seen in the last two paragraphs of section 4, The extra 
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factor 2 in tlie second and third case above is due to the fact that only the even 
moments of (3.20) and (3.21) are used. 

We have in (3.23) and (3.24), then, verj' clo.se approximations to the dis¬ 
tributions for the two X criteria for testing serial effects 

The following table is a comparison of the exact and approximate 5 per cent 
and 1 per cent points for tlie distribution of h. The exact values arc taken from 
the table given by R. L Anderson. The normal approximation as given by 
Anderson in his table does not show such close agreement since he used an asymp¬ 
totic second moment lie indicated that the exact values would have to be 
used for valuo.s of n < 75 in place of the values from the normal approximation 
which he obtained. Here we see that the normal approximation may be used 
for n somewhat less than 75. The Pearson Type I approximation was obtained 
by using the first two moments of h. Tlie curve obtained is: 


(3.25) 


( 1 -b a:) » -^(l - vr^ 
B(p, g)2P+«-^ 


, . , (a — l)(ri — 2) , n(n — 1) 

m wh,»h p - 4 - 

The exact values marked with an asteri.sk in the tabic differ slightly from 
those previously iiublisliod They are more prcvisc' i-alue.s from the exact dis¬ 
tribution which fi Anderson ha.s jiiadt' available lo the author. 


Posilur lad 


N 

Exact 

S% 

Type I 

Norinal 

Exact 

1% 

Type I 

Normal 

5 

.253 

.317 

.281 

.297 

.527 

501 

10 

.300 

. 302 

.350 

. 525 

.533 

.541 

15 

328 

. 329 

323 

175 

477 

.-180 

20 

.299 

.299 

.290 

432 

.433 

,4-K) 

25 

270 

.270 

.274 

. 398 

.398 

.404 

30 

.257 

.257 

255 

370 

.371 

375 

45 

218 

218 

.217 

313*^ 

.313 

.310 

75 

.174* 

174 

v (74 

.250 

.250 

.251 

N 

Exact 

5% 

Typo I 

Negative tail 

Normal 

Exact 

1% 

Type I 

Normal 

5 

.753 

.742 

781 

.798 

.858 

l.OOO 

10 

.501 

. 502 

.572 

. 705 

.702 

, 7()3 

15 

.402 

.401 

. l(i() 

.597 

. 590 

. 029 

20 

.399 

.399 

.401 

, 52-1 

52-1 

. 5-15 

25 

.350 

. 35li 

357 

.473 

173 

.487 

30 

324* 

.324 

,324 

.433 

.433 

.444 

45 

.202 

.262 

.262 

. 356 

350 

362 

75 

201 * 

.201 

.201 

. 27(5 

.270 

.278 
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4. Alternative expansions of the generating functions. In fhi-* 
shall determine the exivet, generating fnnelinii.s which wen‘ apitruxiriinted ui Uhl'i! 
and (3.16) and obtain these .‘'lunc apinn-viiDatinns in iinntlier niaiiiicr. Tliih 
development will enable us to .see Imw gowl tho Hr)i>roxiinatifin is in the kuiw* 
that it gives a certain number of e.viie.t inomentH. The dctcrmiiianf in tlb-l) for 
lag I and mean zero can be written 

\ a l> h] 

T h a h 

'bah 0 ^ 

(4,1) An = I • • • 

1 0 hah* 

b b a 

where a — 1 — Si-, h — —ii and all the other elements an* Z(‘ro. The h in the 
upper right corner and lower left comer indicate the valut* h in Ihr* fit, and rt„i 
positions. T^ot us define the following di'terininnnla; 

ah j h a b 

lb a h i j b tt h 

f) a b t1 b a h 0 


Bn 


(4.2) 


We see that 



h a 

h \ 


(4.3) Bn = nn+ (~l)"“’h", 

Cn = h" + (—1)" ‘bZln-i, 

and An can be expressed in terms of I>„ by substituting for Bn and in the equa¬ 
tion for A„. 

(4-4) A„ = X>„ - + 2(--l)'‘-‘b’‘. 

We can obtain an expression for A. if we expand this determinant by the first 
row. This gives 

^^•5) Bn = aA_i - . 
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Since this is a second order difference equation, the solution may bo written 
D„ = /ciw" + fey" where u, v are roots of the equation r" — ax + = 0. Now, 


(4.6) 


Dj = It + y = few + fey, 

“h y" ”t~ uu — felt" fey' 


so that we can determine fe and fe . We now' see that 


(4.7) 


£>„ = 


It — V 


wluch iHion substitution in the equation for gives 

An = a" + y" + 2(-l)"-'t", 

(4.8) 

= •u" + y" - 2tx, 

where w, y = ^(1 — 2^^) ± V’(l — 24)^ — 4d. Now o'pi(h , k) = Ai^* and it is 
easily seen from the form of A„ dkectly above that derivatives up to the nth 
order with respect to U in which ti is then set equal to zero will be given by de- 
rivatives of An = u" and this is the approximation (3.13) found by other methods. 
The determinant in (3.4) for lag 1 and mean not equal to zero can be written 


(4.9) 


ah b\ a = 1 — 2i2 + 2(h + it)/n, 

bah c 

b a b b = —h 4- 2(ii 4- 

• • • ' c = 4" 

c I 

b a b\ 
b 6 a I 


Let us define the following determinants: 


(4.10) 


Bn = 


bah 
b a b 
bah 


D„ = 


bah 

bah 

hah 


b a 
b 


b a I 
b' 


r 




a b 

b a b c 
bah 


c 
b 

a b 
h a b c 
b a b 


c 

b a b 
b a 


h a 1) I 
b a 1 



130 


WlI.KltH) .T. J>1XI)N 


If W' repUwio tht'- h in tht' niUH'V n^ht cnrinn' of -U ''V r J- r< wt* «i1.tiun 
(4.11) -U - -f- <“!)” '<!> ~ . 

If w, replace the l> in live hvwev left eivnver itf /i., iiiid ( i>v >' *- - c i v,\i' oln uiii 

B„ = n„ + I)" ’(/» - r)K„ I, 


(4.12) 

We now have .4,, in 


r'n - /■:. 4- (-1)" ‘(f« - r)IK.i. 

(('Vine of ami h\ . We unisf unw evulitale l>^ and h\ . 


1 1 I • • 

0 ff 1 ) 

0 h a h 


(4.13) D„ = 


c 


0 


I 


r 


\ 

i 

h a 

h 'nj 1 


1 I 1 ■ • • ! 

— r. r s r 
~r r r U 


0 

r ft 

n • 8 


Avlveve r = b ~ r. and .s a ~ r and the aec.nnd detevminant atinve in tihluined 
from the first by HubtraeliiiK c liinc.s lh«' lirat rowtroni all nlhcr row.-. Writiiifj: 
this last dciomvmanl, as five snin of two detenninantn by ^^t‘pJlv•lttin^; Uie firnt 
column we get 


(4.14) JK - r" - . 

Combining the above difference etpiationn we obtain 

(4.15) .4„ = K ~ /AVs + 2(-l)Vr/'\. -h 'if-l)" V" 

and RGS that \vc. mu.st obtiim A'„ and /'V • 

Expansion of by th(' second column give.s 

(4.16) E,i+t = “frn + rJ''„ 
and expanding On by the hwt row we get 

(4.17) = jfrVi + (-l)"''//„-, . 


= 


0 1 1 • ■ • 1 I 
1 r s r (1 I 
1 r s r 




(4.18) 


r s i 

r Ut 


1 .f r 

1 r s r t) 
1 r » r 


r s i 

r 1 
* « 


Hn = 


s r 
r s r 
r s r 


r s r 
T s 
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n+1 rt+1 

Hn is the same typo as (4.1), therefore = - where u and rare the 

u — V 

roots of the equation x — sx + r“ = 0, so that (4.17) becomes 


t?„ - iGVi = (-1) 


n ri 

n-l u — V 


1C — 1/ 

and the solution of this equation gives 

morn G - , (-l)""'[r(M’‘-i^’‘) + i.’‘+' 

(4.20) - 2 ---^-^ + (,r-«)( 2 r+ s)- ■ ^ 

Introducing this expression into (4,1G) we find 


K = (- 1 ) 


n-l U" — V'‘ 


(u — y)(2r + A’) 2r + s 


1 1 1 - ■ • 1 


1 1 1 • • ■ 1 

0 a 5 


— c s ?■ 

Q h a b c 


— c r s r 0 

c 


0 

b a b 


r s r 

0 b a 

n+1 

—c r s 


(4 22) E„ 


where the second determinant i.s obtained from the lirsl, by subtracting c time's 
the first row from all other rows If we scpaiate this last determinant on the 
first column we get 


(4.23) 


(4.24) r„ = 


En = /!„ - c/„+, 


0 1 1 • • ■ 1 


0 1 1 • ■ ■ 11 

1 s r 


1 .s r 

1 r s ?■ 0 


1 r s r 0 

. . . 

Jn = 

. 

0 



r s r 


0 r s r 

1 r s 


r s 


1 r r 


Expanding by the last row, wc get 

(4.25) 7„ = + sin-i . 

Expanding J„ by the last column, we get 

(4.26) /„ = (-l)"-^(?„_i + 

If we combine these last two equations we find 

(4.27) Zft — sJn_i + r'In-i = (~1)" ^(.Gn-i + r(?„_2). 
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If we now solve this difference equation for wihstituU' fills wiliifion in fhe 
equation for En , and in turn suiistitute this result nrirl the exprchMiiii we ob¬ 
tained for Fn in (4.15), we get 


(4.28) 


w" -b «" + 2^(-l)'’"'r" 

2r + « 

u" + ti" - 2tr 
1 ~ 2(, -I 2fa ’ 


The final form results since 2r -f- s = 1 — 2fi ~ 2<a, r =i- —b . u and i> Imve the 
same values as before. If we compare this re~sult w'ith that obtained in (4.81 for 
mean equal to zero we see that this is the same except that here we have, the 
added factor, 1 - 2ti — 2ili, in. the denominator. Wc hav(‘ a similar result then 
for the approximation for derivatives of ¥>i(b, b) — .'l«* for b t- (). Here this 
approximation is vln == ii"/(l — 2b — 2b), the same result that ohtaini’d in 
(3.18). This approximation will jdeld moments which ar<' e.viiet for n > ak for 
any lag I where a is the largest common factor of n and ?. The nunaon for thi.s 
restriction is easily seen if we consider the expansion ohtairuHl in bb"), bw 


(4.29) 


dip(b , b) 

dir' 


- i<p(b. b) 


2 cos 


2Trlk 

n 


— 2b ~ 2b eos 


intk 

n 


with b = 0, 


(4.30) 


Further 


^ y(b) b) 
ati 


In-o 


■^¥’(0, b) 


-2 cos 
‘l 


'Mk 

11 

2b 


_ <p(0, b)v 2Wfc 

i' _ "nj 2—1 ” 

1. — 2b *-i n 


^V(bib)"| _ ¥’(0, b) 2irlk\^ , ^ xp itvlk 

—ST" J..- “ (“25? US■ f) + 2 £„ 






and the mth partial derivative will contain tlie sum of the with powt'w of tlie 
cosines. These are the sums of the powera of the real parte of the roots of unity 

and it is easily seen that 2 = 2 cos" only for m < c(k where a is the 

largest common factor of n and I, 

To change the moment generating function of hi to that of h we must drop the 

last term of the product. In the above expressions wc then have Y) cos”’ 

jfcl u 

and the same conclusion, ■will hold. 
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6. Application to successive differences. If we change slightly the function 
V = h\-\/Vn investigated by von Neumann and Williams we find the moments 
and distribution greatly simplified. Let us define 

(5.1) 5*„ = Yh ixi — 

i->L 

where = xi and consider the ratio oiji of to Sa:; . Now, 


therefore 


= 2'Z,x\ — 2Sa:,a:i+i 


oiji = = 2(1 - ho) 

Sa:, 


and we may find the moments and distribution of oiji directly from those of 
&o. We find the moments to be: 


m.i = 2 


2 + 3) 


f5 4^ - 2°(n + 5) _ 2\n + 5)(n + 7) 

^ ^ ' n + 2 * (n + 2 )(ti + 4) 

2*(n + 2 fc-l)! 

(n + A:)! (n + 2)(n + 4) • • • (n H-'2A: -2)’ ^ 

and the ratio oi)i is distributed according to the law 

(5.6) Clout"-"(4 - oui)*'"-" 

up to n moments 

If we replace ip the above ratios by x, — .S we find the moments of the ratio 
Ui = s5i/2(a;, — Yf to be: 


n — 1 


(5 6) vu = + 4)(r + 5) 

(n - l)(n + l)(n + 3) 


2^n(n + 3) 
in — l)(n + 1) 

2Si( r + 5) (a + 6)( n + 7) 

(n - l)(n + l)(n + 3 )(ti + 5) 


2«^n(w + 2A; - 1)1 

“ (a + fc)r(R - iKn + ijin + 3) • “(n +"2^' - 3) 
and (ui — 2)^ = 2 has the distribution 
(6.7) Cj2"‘(4 - 2 )*'"-'^ 

up to moments. 

The ratio compares the variation of the first differences to that of the 

original variates We might wish to compare the variation of the second 
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diffcrenccb to that of tho lirt^t tliffomu'cs. Fni this ]mrj»iK*t* let ns Surin the rsilin 


(r, ~ 2r,,i + 

I*"! 


. I jr, 


i:(x. 


to Usst the liyjiothcsiH that tho variation of the acrnnil difTcn’m’vs tantniarwl 
to the variation of the first (lifFori'ncc.s is sn(‘h as vronhl iH’cur hy rhaiici*. Lc't 
•I'l) t'2, ,'C„ hr normally (listrilnitctl with iu»‘aii a and varituiri' tf'. 'Fiif 

ratio ijj is indepr'iulrnt of tlio mean value of tlir Miriufes, tliereforc we iimy 
conaidoi a diatriliutiou with iiu'an equal wro. We* shall develnit thi< mean and 
vanancci of 7)2 when the hyiiothesis to he tested is true*. 'The iiuiuirml freiii’i-atmt!: 
I'aiiction for the joint distrilmtion of /ij - 2r,.t 4- .r,,;!"* t.V'and /h - 

2:(n'. “ .T, H)V2<r" is 

>p(U, k) = /i^[exp (/)s/l + 

- {vl .)" LI L <- "■'= - i -'■} U 

We may find tlie niotnenis then hy a proeess Himilar to tlmi outlined ni fd 2| 
and (!i.3). 'riie, iio\t few steps are idenlieal with (d.dl and (d.rn, Feir the pres¬ 
ent problem, lunve-vei', m - 1 - (ih - 2h , n, ‘i/t 1 h , ue /, so Ihut 
>1 

V'’ '(.h, U) == IT [1 “ Wi ~ + (-Ui + li)(o)l, 1 " wj.') ■ • /pwi h uJe.®)i, 


I — tid — 2i2 -j" (lid H” 2/3) eos 


2d I'os 


TT r _L 1 I 

= ii a + 0 cos + c eoH 

/.“i L « a _ 

If wc follow the same pioeedure indicated in (3.S) to (3.13) we obtain succes¬ 
sively 

n 

(5 n) ifUi, d) = n (a -f- 0 eos a* -f- c eon 2tv;.)~* 


— 2) lull (oH< rimo* 1 <■ cun s«iiJ 

0 ^ t-i 


~ ( I “ 52 loft {« -h It eos (5n + c coH 2<n) 

\ 'ITT /t AimI ^ 

and leplace the summation by tho integral which is the limit of the « 
as n —» cc. 

/ j'2r 

(5 14) ^ 2 ) ~ exp jf log (a + 6 cos a -h c cos 2a) 

(5 15) ^ exp log [. L±Vi:^ 5= 1 + Vl - 


smiiniation 
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where 


iv = a — c; 


1 ), S = 


b ± \/b‘‘ + 8c^ — 8ac 


2(a — c) 

We then have approximately 

(5.16) v>(h, y ~ [i^d + v'r'-T^)(i + 

(5.14) follows from (5.13) if we replace the summation by an integral, and (6.16) 
is obtained in the following manner: replace cos 2a by 2 cos*^ a — 1 and factor 
the resulting (inudratic and integrate the factors separately 

n'lv p2T 

/ loo (a -f cos a + c cos 2a) da = log (a — c + 5 cos a + 2c cos^ a) da 
Jo Jo 

p'Jtt /t2T /%2r 

(5.17) = / log K da + j log (1 + 5 cos a) da + / log (1 + »? cos a) da 

Jo Jo Jo 

= 271 log K + 271 log §(1 + \/l — 5”) + 271 log ^(1 + \/l — 7)^). 

If we now' e.xpand (5.16) by multiplying the factors within the brackets and 
substitute for k, v and 5 we find 


(5.18) 

where 


<p{ti . la) - [A + B + C + D]-^" = p-‘", 


a = 1 — 6ii — 2b, 
b ~ 8ii + 2b 1 


(5.19) 


A = -HI - 4b - 2b), 
jB = Hi — 12b 4b + 8bb + 2b 
— 2(4b + b)"V^ b + 4b]\ 
c = —2b , = HI — 12b — 4b + 8bb + 2b 

+ 2 (4b' + b)V^ A + 4b]*) 
Z) = J(1 - 16b - 4b)*. 

From (5 18) P = A+ B-\-C-\-D and at b = 0 
P = i(l + •'/l — 4b)^ 

(5.20) ~~ = ~2[1 + 2(1 - 4b)~*.]. 

cl^P ^ -32 _(l-V'l-4b)' 

011 (1 - 4b)' 


2ll 


Now 

d(p 

-inP- 

(5.21) 

^ “ 



cp 

dtl "" 

-inP" 


In-l ^ 

dti 
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If we substitute in this formula uml integralf flic Orst with roiwct (o tj wc dm 1 
obtain the first momoiit of the uitiu tj- . If we intcunilc fh.- ^.cml tu uy m ,th 
respect to h , we shall obtain the sccoiul nmmciit of tlic ratio n.> «'* hud tb.a-c 

moments to lie 


(5.22) 


:bi + 2 ,, '.hr -i- 23/1 0 12 

“ u + t " t'l 1 n(// -i* 2) 

■i __ 2/1^ + 7n + ■! 

" (ft + i)H)i -1- 2)' 


6. Likelihood criteria for multiple serial correlation, (liven a humple of 
n observations, -ti , Xs, .A'«, we shall assume that they are ilistrihuted 


according to the law 



that is, that each variate, say at the time, i, ha« as its mean value a linear funetiun 
of the vaiiates at time I ~ h , I ~ U, etc. l/Ct us investigate the likiOila kkI eriterin 
for testing the hypothesis, Hr i that each vamite, is iiHlejH'iuleiit of the others; 
i.e. that the b< = 0 (t = 1, • • • , r). For the hypothe.sifi //, we tieline the .space 
fi and the space «, as follows: 


(0.2) 


■fi; cr’ > 0 

w: <T* > 0 


— w < a, h{ < “s 

— oo < a < M, 5, « 0, 


we find the likelihood ratio criterion 


( 6 . 3 ) 

in which 


■^iln _ I UiJ i 

Coo I (Ipq j 


(6.d) 


floo = 2 (Xa — .£)* 

et 

Uo, ~ y J (Xa X)(Xn,j,(, “ ,f) 


fl,j — (xa;,|if .r)(xoi/y x) 
a 


f, j th ], •' ■ , r 

p, 9 =^- 1, 


and it is noted that aa = Ooo and if the I, arc ciiuispaced o,.i k f*«- - k, is a 
statistic which measures how completely each variate at time I can he e.xpnwed 
os a linear function of variates spaced at time I — h, I — k , etc. 

Next we shall develop a statistic for testing the hypotlicHis, //i-.rt , that of the 
set of the values b; (i = 1, • • • , r) in (0.1) the subset bm+i , lUn , ■ • • , l>r =0. 
Here we have the same likelihood function but for //r.m , wc deline the apaccs 
fl and u as follows; 


n: 


— «> < a, b, < 03; 

— 00 < a, bu < m, bu, = 0, 


« = (1, ■' • , m), 11) = (m. + 1. • • • , r), 


(6.5) 


u: 


> 0 
> 0 
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and obtain the criterion 


( 0 . 0 ) 


.^2/n _ I 1 i 0,uv I 

^r.Trt “i r 

I ^Pt 11 1 


I, y = 0, 1, ■ ■ • , r, 

P, q = h • ■ ' ,r, 

5, i = 0, 1, ••• , m, 
u, V = I, • • ■, m, 
(m < r). 


The form and the derivation of these X criteria parallels very closely that of the 
likelihood ratio criteria obtained in multivariate analysis for testing significance 
of regre.ssion coefficients. 

Case I. If we set r = 1 in Xr we obtain 


(0.7) 


X?'" = 


Oco doi 
fitoi doo 


Ooo doo 


. 1 _ i-. 1 _ i<, 

dOQ 


for which the distribution is given in (3.24). 
Case II. If we set r = 2, we have 


( 6 . 8 ) 


X?'" = 


doo 

doi 

ao2 

doi 

dll 

dl2 

d02 

dl2 

d22 

Ooo 

dll 

dl2 

dl2 

d22 


for which if we take h = 1, Z2 = 2 we get 


(6.9) 


doo 

dot 

d02 

dOl 

doo 

dot 

d02 

doi 

doo 

doo 

11 

doi 

doo 


The expanded form of this numerator is Ooo + 2aoiao2 — odoHm — 2aoiaoo. 
Let u.s consider 


( 6 . 10 ) <^-( 00 , 01 , 02 ) 


= ( 


0 -/ J-or J 


n aXa . 


We shall find the mean and variance of 0X2^" (mean = 0) when the hypothesis 
ollr (?■ = 2) is true. We can find the first moment of oXs^" then by performing 
the following operations: (a) compute 


( 6 . 11 ) 


J’ jj- 2 ^ 

500 001 002 


dtp d fp 


d ip dip 


- 2 

a^o aa2 500' 


(this will give the first moment of the numerator) and set 02 = 0, (b) integrate 
from — = to ^0 + 01 with respect to 0o + 0i = f, from — «> to 0o — 0i, with 
respect to 0a — 0i = and set 0i = 0 (at this point we will have the first moment 
of the third order determinant divided by the second order determinant), (c) 
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intogratc with risspc't'l In 0(i frnm — f- fit (f. 'The VfUMiii fin s»<‘ 5 ) I'u-ili 

seen since the scwmd nnler delerminant ii:, n'l iimv In* <f,,( 

(Ooo + Ofli). 

Further moiiieiits itiuy lie CMiuputed in n Miiidar iiiaiuiej . , w, , //,( 

may be written iis a delenninanf in (lie tnaunei indiealed in .'S li huiI aHai. 
Here, ai = 1 — Og, Oi (i„ •- ~\(li and n-i - ^ and ri( f<i ^ t(. 

then 


( 6 . 12 ) 






(t\. f 






Wc shall approxiniiite ov^ifOo. 5i, 5.) by the 
and (5.18). We act 

iiiediiHl e 

mt!allied between {"t.tli 

(6.13) 

av=2(5(ii 5) 1 B-i) = d' 5 ens 

2jrt 

l- r ( 
II 

■11- ’ 
a / 

and obtained 




(6.14) 

ov'i(5o. 0 ,, 5.) - {.4 -f fi d- f 

• d- in *- 

P 

where 

= Ka - cl 

n «= J(da- - -Ic* - 25" - 

2/t/v*)’ - 

'J 

(6.15) 

(' = K4n’ - -Ic* - 2/C f 

■ 2/»7«;‘)' 



-D “ K(a + c)* ~ /c)» 


- 


ii' = + Sc(c ~ rt). 




It is easily seen that wo may oponUo (differentiate and inte(jrat 4 M with n, h, 
c, in place of 6o, 0i, 6i respectively. Thereftue, we i;onipute 


(6.16) 


5c 6c 


(p 




-p.-5 


(-Jn - 


1 ) 


f{)py 

V5c/ 


+ P 


<f P 
fl('‘ 


and since P = yl + B + c' + jDwo compuU- 


dA 

Be 

BB 


1 

~v 


= 0 


(6 17) 


Be Bo ’ 

_ 1 --i dy 
= To ’ 

BD , 3e 
BE 

— = 16c — 8o; 
do ’ 


,fA 

Bc^ 

B^B _ 

5c* io 




+ d 


ac* 

5“D 

5c* 

Bc^ 


\{f>y 

5c 


+ T 


5r* 

1 5% 

5c* 


■] 


+ e 


-J 5_J 
5c* 




= 16. 
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In order to cvalnatc the expressions in (6.17) we must find 


(0.18) 


If we now sot c = 0, wo obtain 

P = Ka + (a' - 6*)*) 


f = -8c - 
dc dc 

f.? _ -8 - i,e-< 

dc- 

;-2( 

'0/0 


dc dc 

^ = -8 + bP- 

1 

[_1 

/OE 
\ r)c 

I - 1 

■+ 

+ 

1-; = 2(0+0; 

-2 = 2. 





(6.19) 


dP 

ac 


a - {a - h^y 




2(a2 - b'^y 

d~P _ 2a'‘ - 4a^b^ + b* + (-2a + 2a6°)(a" - 
dc^' 


2b\a‘ - b^y 

We may now substitute these values in (6 16) and then substitute the resulting 
expressions in (6.11), The remaining values that are required for (6.11) aic 
easily computed since they may be obtained from <p with c = 0, i.e. 

(6,20) ,e,,Q) = [i(a + (a^ - f)”)*r»'‘. 

The result of these substitutions gives 

(6 21) -n^(n + 3) p-*- ^ 

' 8(a2 ->)i ’ 

in which we set d = ^(a — b) and c = K® + and integrate with respect to 
d and e. We obtain 

( 6 . 22 ) 


m + (a“ - ()“)*)]■ 




2(n + 2) 

and if we set b = 0 and integrate with respect to a, setting a = 1, (0o = 0), we 
finally have 

2/rt\ _ n 


(6,23) 


^(oX^'") 


71 2 

We shall now obtain the first moment of X2 without the restriction that the 
mean equal zero. For this purpose let us consider 

(6.24) ^(00, 01, 02) = £”■ ■/ n dx ,, 

Here oi = 1 — 0o + wi, 02 = o„ = —|0i + m, Ca = o„_i = -|02 + m, Oito 
a„_2 = m where m = (0o + 0i + 02 )/n. Expanding the determinant as in 
(6.12) we find 


(pi ^ (00, 01, 02 ) = nr at (ilk ^ 

Jfc“l 1^1 


= II c 

\ 


n-2 


I _ 27rft , _ 4ir/b , ■v~' 

tti + 202 cos- + 203 cos — + 2 ^ tti toi 

n n t-i 




(6.25) 



MO 

wii.Kuin J, 1)1 SON 


Now 

ft— C ti—2 

^ 0, wr’ = in ^ 


(6.26) 

1 — 7n(l + d' w* * "h w* + w 

k ^ n 


1 m(n “ 5), 

k ■ n 

so that 



(0.27) 

‘Pi"'i6o, 01 , 0a) ~ Xi.(ni + 2ai cos -h 2o3 cos , 

i«i \ n n / 



We have obtained here a product which is tlie same as that in j'xcept that 

the last factor is missing. The approximation corresponding to (tl.Ml will 
then be 

(6.28) ^''*+4+ 

since we may take the approximation for the pnKluct from 1 io h and divide 
by the last factor, (a d- h + c). The procedure for finding the Iir«t moment for 
Xa (mean = a) is exactly the same as that outlined for finding the first inonumt 
of oXa (mean = 0). We obtam 

(C.29) = ”■ 7 . 

Case III. If wo set r = 2, w » 1 in Xr.m wo have, if we lake h I, h ~ 2 


Ooo 

Ooi 

Out 

OOl 

Ooo 

lloi 

cun 

Ooi 

Ooo 


Ooo 

Ooi I** 


Ooi 

OmI 


To find the moments of Xa.i let us consider the following di.sti iltution, 

.(6.31) iP. 

in which p represents the population value of the serial correlation coidFicieut. 
The moment generating function for the joint distribution of aM/2«r^, a<n/2a^ 
and aml2cr^ will be 

01 . 0») = I'j’j exp { 2 ((a‘, - .f) ~ ™ £)r 

—■ 001)00 "■ 00101 ”■ O(«02}^ If dXtt 

■ (vfc;) I.- 7 “p (-2? 

+ OoiC—2j3 — 0i) + ao2(—0j)]^ n doTa. 


(6.32) 
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This function is very similar to (6.24). The approximation to y2,i(0o, 0i , Sj) 
here will be exactly the same as that obtained in (G 28) for , 0^) except 

that here a = 1 — 6a = — 2/3 — , c = — 02 . For the case where the 

mean is zero, we find the approximation (6.14) in which a, h, and c have the 
above values. 

We may obtain the first moment of Xs.i by operating on the function 
i52.i(0Q, 01 , 02 ) proceeding as follows: (a) compute (6.11) as before and set 0j = 0, 
(b) integrate from — » to 0o + 0i with respect to 0o + 0i = f from — « to 0o — 6i 
with respect to 0o — 0i = f (at this point we will have the first moment of the 
third order determinant divided by the second order determinant), (c) differen¬ 
tiate with respect to 0o, (d) repeat step (b), and set 0a and 0i = 0. 

The first two steps for obtaining the first moment of oXa.i (mean = 0) were 
performed for the first moment of 0 X 2 so that we may perform step (c) on (6,22). 
We obtain 


(6.33) 


nM(a + (a^ - 6=)^)]-»"-* 
4(a= - b“)* 


and finally by step (d) we have 


(6.34) E(a\l!C) = + (a' - 

n -j- 1 

in which a = 1 + and b = — 2/3 since 0o and 0i have been set equal to zero. 
Substitution of these values in (6.34) shows that it is independent of i3, and we 
find 

(6.35) B(a\V.{) = — . 

71+1 

Using v? 2 ,i(^o, the generating function for (mean = a), we find 

(6.36) 

n 

The procedure for obtaining the second moments of the above criteria consists 
essentially of performing twice the operations prescribed for obtaining the first 
moments. The details given in connection with the first moment are sufficient 
to indicate the procedure. The details for the second moments are too com¬ 
plicated algebraically to list here. Table I indicates the second moments ob¬ 
tained as well as other moments obtained in the earlier parts of the paper. 


7. Serial correlation in several variables. Given a sample of n observations 
on each of k variables Xia , i — 1, ■ • • , k, vie shall assume they are distributed 
as follows: 


(7.1) 


dP„ = 


A 


(2x)‘''*’ 


We wish to test the hypothesis Ilkn that there is no serial correlation, i.e., that 
b, = 0 ,1 = 1, • • • , k. For this purpose let us define the space 0 and w as follows: 


I Ai, II pos. def. — «> < Oi, bi < «> 

I II POS- — <» < a< < =0 ; b, = 0 . 


(7.2) 


w: 
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TAltbK I 




formula mi i 

.1 

K{x) 

K(x') 



ha 

(2.11) 

0 

1 

n -1- 2 


1 

I) b 2 

* 

j 

( 2 ,in ! 

~1 

n - 1 

I 

n b 1 

in 

7irii “ ai 

- l)’(n !■ IJ 

1 

u»li 

(h.3) 1 

1 

2 

4(« + a) 

?i b 2 


} 

II f 2 

1 

1 

1)1 

(5.3) 

2n 

n - 1 

4k(« T 3) 

(« — l)(;i -b 11 

lu 

•l77in ““ 3) 

-- li-lii b 1' 

i)a 

(5.8) 

:bi + 2 

11 + 1 

On- + 2an -b 12 
(/; -b l)fn b 21 

2»'-* .}. 7n -f' -1 
in 1- 1 bU7 i- 2» 

wXi 

(2.10)fl‘. 

11 + 1 
)i "t* 2 

(n + l)(/i -b a/ 

. (n -b 2)(n b 4) 

ill 

2/77 j b) 

» 21'‘< It i 11 


(2.10) 

yi 

n -b 1 

n(« + 2) 

(?y + l)(n + a; 

i II 

2n 

1 1 «•'< It } a 1 

0 X 2 

j (6.a)fi. 

r 

a 

11 + 2 

i a 

11 b 4 

{II 

In 

! 2)-(7( j 1) 

Xi 

1 (0.0) 

\ 

! 

; n - 1 

1 n + 1 

1 

11 - 1 
n 1- 3 

(» 

l(n - 1) 

b i)-i« } as 

oXi.i 

(0.30)11. 

1 

i a + 1 

n()i + 2) 

1 (« -1- 1)(?4 -b 3) 

III 

2n 

b !F(77 ( ai 

Xs.i 

(0.30) 

1 

1 n — 1 
; 

(71 - l)(n + Ij 
^ ri{ti + 2) 


2(/i — 1) 
iiHii -b 2 / 


The mean of ha and h were also obtained by Anderson |Hl. 


The development of tho appropriate X criterion for tins case inu'tillelw very closely 
the development of the X criteria in multiple regroKaiun amvlysis. llie ertleriou 
obtamed for testing the hypothesis Ihn is 


(7.3) 

where 


2/11 




ffl(, h.j I 
bi) Oiyl 

I r- 


(^la ' ' .11/)) 

a 

b>l ~ ^[22 (■•'•a '■•'«') %) + 22 (.’'i.a+l " 

The probability theory for the X criteria in (7.3) remains to be developed. 
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8 . Summary. A problem m serial correlation which htis received considerable 
attention is that of devising a statistic for indicating the, presemee of a relation 
between successive observations, i-c. a lack of independence of the order in which 
the ob.scrvation,s weic drawn, Von Neumann developed the- distriljution and 
momcnt.s of the ratio of the moan square succe.s.sive diffcrencis to the variance. 
R. L. Anderson presential the distiilaition of a serial correlation c.oefheient which 
is the ratio li = {I > 1 , subscripts reduced mod n). 

The present investigation was undertaken with the object of developing the 
likelihood ratio functions for testing various hypotheses connected with serial 
coiTelation m one or more variables and deteiinimng the moments and in some 
cases the distributions of these likelihood ratios 

The variates aic considered to be ordered by iheir snbsciipts a: = ], ■ ■ , n. 
The introduction of .-En+i = Xi, x„+i = X 2 etc. is made to obtain a symmetry 
which greatly simplifies the problem. 

The likelihood ratio criteria were developed for testing the hypotheses 

a) that Xa is independent of Xa-n 

b) that Xa IS independent of , i = 

c) that aja ia independent of some subset of the Xa+i, 

d) that in the case of several variables Xia, ! = 1, • • , k, a = [, , n 

the a;,a , t = 1, ■ • , k are independent of the These criteria arc snnilai 

in form to those obtained in regression analysis, 

The likelihood ratio criterion for testing the hypothesis a) turns out to be 
X = (1 — whore R is the function given above The moments of R arc 
obtained and from these the moments of x''‘^’'. These moments arc found to 
agree with those of a Pearson Type I curve to n/2 moments A simple tiaiis- 
formation gives us the moments of a ratio differing from that used by von 
Neumann by the addition of the term {x„ — x^f to the numerator. A simplifica¬ 
tion of the moments is attained by this change, In fact, if we denote this 
altered statistic by ij we find that (77 — 2 )^ is distributed according to a Pearson 
Type I cuive to n /2 moments. 

The mean and variance weie determined for the ratio of the sum of squares 
of the second successive differences to the first successive differences. 

The mean and variance are obtained for the likelihood criteria for testing 
the hypothesis b) for r = 2, and for testing the hypothesis c) for r = 2 wlicie 
is the subset of ; (^ = 1, 2). 

All the above rnomonls wore olitaincd under the assumption that the hypothe¬ 
sis to bo tested was true. No results have been obtained thus far in cases b) 
and c) for a general r nor for hypothesis d). 

The moments for the several cases above were obtained by the use of moment 
generating functions which, for the criteria used, took the form of the product of 
n terms In the case a) it was shown that the product could be approximately 
represented by the nth power of a single expression which was equivalent for the 
purpose of obtaining the first n moments A method was developed for making 
analogous approximations to the generating functions for cases h) and c) since 



144 


\Vn,KHII> J. DltflN 


it was not found po'^^ihlo fu obtain the )iumienti< frniu (in- jifnlm-fA in fhrir 
original form. 

Thd author wlslu’h lo exiirrsa his grn.tit\itle tu Pri'fr.sai.r .4. S, Wilk> under 
whoso hnlpful dliTction tliis paper wita written. 
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ON A STATISTICAL PROBLEM ARISING IN THE CLASSIFICATION 
OF AN INDIVIDIIAL INTO ONE OF TWO GROUPS* 

By Abraham Wald 
Columina Universiiy 

1. Introduction. In social, economic and industrial problems we arc often 
confronted with the task of classifying an individual into one of two groups on the 
basis of a number of test scores. For example, in the case of personnel selection 
the acceptance or rejection of an applicant is frequently based on a number of 
test scores obtained by the applicant. A similar situation arises in connection 
with college entrance examinations. Again, on the basis of a number of test 
scores, the admission or rejection of a student has to be decided. In all such 
problems it is assumed that there are two populations, say and ira, one repre¬ 
senting the population of individuals fit, and the other the population of individ¬ 
uals unfit for the purpose under consideration. The pioblem is that of classifying 
an individual into one of the populations in and in on the basis of his test scores. 
Often, some statistical data from past experience arc available which can be 
utilized in making the classification. Suppose that from past experience we 
have the teat scores of Ni individuals who are known to belong to population in , 
and also the test scores of Ni individuals who are known to belong to population 
t 2 . These data will bo utilized in classifying a new individual on the basis of 
his test scores. 

In this paper wc shall deal with the statistical problem of classifying an in¬ 
dividual into one of the populations iri and ira on the basis of his test scores and 
on the basis of past experience, given in the form of two samples, one drawn 
from iri and the other from ir^. In the next section wc give a precise formulation 
of the statistical problem and state the assumptions we make about the popula¬ 
tions iri and Vi . 

2. Statement of the problem. Wc consider two sets of p variates (a;i, ■ ■ , 

and (yi, ■ • , i/j). It is assumed that each of the sets (ki , and 

( 2 / 1 . • ■ ■ I Vp) has a p-variate normal distribution and the two sets are inde¬ 
pendent of each other. It is furthermore assumed that the covariance matrix 
of the variates a-j , • • • , is equal to the covariance matrix of the variates 
2/11 ■ ■ • 1 2/j)) ie- 0 -*,*, = <rv^y, (f, i = 1, •' , p). We will denote this common 
covariance hy a^j. Lot us denote the mean value of .Ti by Mi and the mean value 
of Vi by ri. Furthermore wc will denote the normal population with mean 
values Ml, • • • , Mp and covariance matrix |1 cr.j jj by iri, and the normal popula¬ 
tion with mean values Pi, • • ,vp and covariance matrix 11 cr.j 11 hy ira. 

A sample of size Ni is drawn from the population in and a sample of size Ni is 


'The author wishes to thank Dr Irving Lorge, Columbia Univeislty, for calling Ilia 
iitteiition to this problem 
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dr&.wn. from tire population Ti. Di'iuitf hy x,a tfu' a-11i u!jfa.*rvatiou on x, 
(i = 1, • ■ • ,p, a = I, • • • ..VO mill the/t-thtiliHtu-vali.m till (i 1, . p; 

|3 = 1, • , N'n]. Let c, (i — 1, • • . ;m 1ii‘ u Mnp:l(' iihwrvidion oti the r-lK 
variate dnuvu fioiu ii p-vanate population «•, when' it in kiiowii a luiou fluP v i.s 
cither identical with iri oi with in 'I'lu* eel (2i. • ■ , is ar<Mim«'d fti he di^j- 
tribnted independently of (,ri, ■ ■ • , .Cp) and Un , ■ • . »//*. 

We will deal here, with the followinf!; .stiitiatieal pruldem: t )n f li“ ha.Hi^ ni th<- 
observations , y,f,, z, (t *- I, •••,/»; « 1. • • • , A'j ; - L ■ ■ . .V i we 

test the hypothesis Ih that the population tt, from wldeli the set ha« 

been drawn, is equal to iri. The paranietms m , ■ • • , a,,, e, , • ■ . te, and 
II ffij II are assumed to he. unknown. 


3. The statistic to be used for testing the hypotliesis Ki. lu Ihi'. pioldeui 
there, exists only a single alternative hypothe.Ms to tlio tl-hvpoth'sis f/j to he 
tested, i c. the hypothesis //•; that t is equal to -n . If the piuameters fo , ■ • ■ . 
Pd . “i, • ’ • , V,, and i| <r,j i| were known we eould eadiy tiiu! t,ou the basis of a 
lemma by 'N’eyman and Pearaoiil the critical region which is nio.^i itowerful with 
respect to the alternative IL. fad, us assume for the moment that Ihi* imni- 
meters m , • • , , si, ■ • ■ , Sp and tr,, j] are known and let im eomptile the 

critical region for testing fix which is most, powerftd with resinuM to the alleniiV" 
tivc /fa. Aecovditig to a lemma hy Nt*vman and I’eai-son* this erilieal region is 
given hy the inequality 

(1) ‘ > k, 

JhC^i, •' • I 2p) 

where Pi (zi, • • ■ , Sp) denotes the joint probability density fnnel ion of ;s, • • • , Sp 
under the hypothesis I/i, paf^i, • • ■ , Sp) denoh's tin' joint prulmhility liensity 
function of ( 2 i, • • ■ , Zp) under the hypothc.sia Ih , and k is a eonstaiit tltdermined 
so that the critical region should have the required siz/C. 

Denote the determinant value 1 tr.-j j of the matrix |j o,, j! hy Then 


( 2 ) 

and 


Pl(2l, ■ • ■ . Zp) 




P 

-IS 




} 


(3) 


Pi{Z\ , • • ' , 2p) = 


1 

(27r)>’/Sa 


-til 2)'“o, -fp 


t 


where the matrix H |1 denotes the inverse matrix of the matrix ii ff. / !i . Tak¬ 
ing logarithms of both sizes of the inoiiuality (1), w'e obtain tlu‘ inequality 

(4) - Z) — Vj) — (Z, - g,)(2; - > log k. 

7 * 


^ J Neyman aud b pBAUfaON, **CoutrU)uti(>iih U) tho thoory of Ipatuij^ i^tatiHUcul 
hypotheses/’ Siat. Res Mem , Vol 1, London, 1930 
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JvIultiplyinK l)oth sides of (4) by 2, we have 

(fi) Y, Y - ^tl) - (s. - v^){z, - V,)] > 2 log k. 


The eritieal region (5) is most, iioworful with respect to the alternative Ih , hut 
it cannot Ix' used for oui purpo.ses smoe. tlic iiarametcrs m , ■ • , , Vi, ■ ■ , Vp 

and II (Tij i| are unknown The oiitinium estimate of a,, on the basis of the ob¬ 
servations .i',„ and um is givem by the sample eovaiiaiiee 


((i) 


''’b 


Vl Vi 

(-iiK ■ri){.rjot -fj) "b 'Y (Vifl 2/i)(i/;js “ Vj) 
a—l X-1 

M + N Y- 2 


'Y/ 

where i\ = " and ff, = ^ The optimum e.stimates of a. luid Vt are 

A' 1 Ni 

given by .r. and ij^ re.spectivcily (i = 1, • ■ ■ , 7>)- Hence for testing //i it seems 
reasonable to n.se the .statistic li which we obtain from the left hand side of (5) 
by sub.stituting the optimum estimates for tlie unknown parameters. Thus R is 
given by 


(7) R^YY - mz, - .«;) - (^. ~ i/.)(2; - yA 

] V 


where || s*'' || = || s,-j || \ The ciitical region for testing Ih is given by the in- 
eciuality 


(8) It > C\ 

whcie C is a constant determined in such a way that the critical region should 
have the required size. It is interesting to notice that R is proportional to the 
difference Tl — Tl where if', {i = 1, 2) denotes the generalized Student’s ratio’ 
for testing the hypothesis that the .set (zi, , Zp) is drawn from the population 

IT, In our case the statistic Ti cannot be used for testing Ih , since Ti is appro¬ 
priate for this purpose if the class of alternative hypotheses contains all p-variate 
normal populations having the same covariance matiix as in . In our case the 
class of alternatives consists merely of a single alternative, namely, the alterna¬ 
tive TTa . 

For the sake of certain simplifications we .shall propose the use of a statistic U 
which differs slightly from the statistic R. In order to obtain U, we consider the 
inequality (5). Since a-'-' = a-’' this inequality can be ri'duced to 

(9) Y Y - Ml) > k', 


where k' denotes a certain constant. The statistic U is obtained from the left 
hand side of (9) by substituting the optimum estimates for the unknown para- 


’ See. in this connection H Hotelling, "The generalization of Student's ratio,” AnnaU 
of Malh. Slat , Vol. 2, and R C Bose and S N Roy, “The c.\act distribution of the Stu- 
dentizod statistic," Sankhya, Vol. 3. 
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[' »,(!/} “ 

and the critical region is given hy the iiu'iinality 

(11) f’ 

where the constant d ia cluiwm mt that fl,e rritieal regiur. ..Incild h,ae th.- rr- 
quircd size. The htatintic f,' ditTerH frnin It merely Ity a form whu-h .W's jml 
depend on the ciuautities z, • If -V. and .V, are large the -hderenre 

17 - ft is practically constant and therefore the critical regmiw (h i .and .,11 « arc 
identical. The use of U seems to 1«‘ iw justitiahle as that of ft atid lwi'a\i‘'C nf 
certain simplificationR we propose the use of the critical rcgiiui ill i. ^ 

The statistic U is closely eonneoted with the .'<o called discrmnnan) liiuctmu 
introduced by II. A. Tishcr for discriniinatiiiK ladwecn the two (mimlfitniii.H tt, 
and n . The discriminant ftmcUon 1) i.s given hy 


(12) D = hidi + Ml -h ■ * ‘ + lyfe 

where d, = Hi “ .f, and tlie coefficient h. is proportional to £ - ■ 'I'l"* '*<i- 

effioienta &i, • • ■ . 6„ are colled the ciKdlicients of the diserimmant function. 
Wo see that 17 is proportional to the stalistie. b^z, which is ohfaiur.l from the 
right hand side of (12) by substituting z, for di . 


4. Solution of the problem when Ah and iV» are large, Dmiute by Fil \ A', , 

1 TTi) the cumulative probability distribution of I- under tlte hyI^othe,Hi^ lluit 
the set (zi, ■ • ■ , Zp) has been drawn from the population rr, [i ^ 1, 2). If Ah 
andiVjapproachinfinity the distribution ft(f7, Ah , Ah| t,) eoiiverge.'+toanormiil 
distribution, since the variates s,,, and Hi converge stindumtically to the 
stants au n, and e, respectively (i,j == 1, ••• ,p)- I,<‘t us ilenoU* liiu I'll , 

^ ' V > •«»*» 

N't, W 2 1 ir,) by $(7/ | iff) {i = 1, 2). Furthermore denote by «. the mean value, 
and by ai the standard deviation of the distrilnition 4>(77 \ w.) (i 1. 2). It i.s 
obvious that ci = at = tr (say). It is easy to verify that the variate;* 


(13) 

ai = - i/), 


(14) 

at = - 7-/), 





(16) 

1 Ma 1 At*** 1 

- >tl), 


k-l 1-1 


converge stochastically to the constants <* 1 , an and c* respectively. 


* R. A.Pishek, "The statistical utilization of multiple measurenientH," Annuls nf Kugm- 
ics, 1938, 
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Ilenpp foi lai-ge valvies of A’’! and Ni we can assume that is normally dis¬ 
tributed \vith mean value «.• and standard deviation a- if the hyiiuthesis //. (i = 
I, 2 ) is true. Thus the critical region for testing 11 1 is given by the ine(|.uality 

(IG) U > at 

1 r** 

where the constant X i.s chosen in such a way that dt i.s equal to the 

V 27r J\ 

required .size of the e.ritical region. 

Finalh', .some remarks about the proper (;hoicc of the .size of the critical region 
may be of intcre.st. Two kirid.s of error may be committed. Ih may be rejected 
when it is true, and Hi may be accepted when Ih i.s true. .Suppo.sc that Ifi and 
Wi are two positive numbers expressing the importance of an error of the fimt 
kinfl and an error of the second kind respectively. If the purpose of the .statisti¬ 
cal inve.stigation is given it will usually he possible to detenuine the values of 
Wi and IT'o. Wo shall deal here with the question of determining the size of the 
critical region as a function of the weights IFi and TFs . Denote by P, the prob¬ 
ability that (16) holds under the assumption that IIi is true (i = 1, 2). Then 
Pi is the size of the critical region (also the probability of an error of the first 
kind), and 1 — Pj is the probability of an error of the second kind. Both prob¬ 
abilities Pi and Pj are functions of X and arc given by the following expressions; 

(17) 

and 


(18) 


P 2 = - 7 - f e-“'‘ dl. 

'V2ir Jusi-aji/n+x 


From (13) and (14) we obtain 

(19) 52 - ai ^ 12 - ®.)(27 j - £,)• 

i • 

Since the right hand side of (19) is positive definite, we have Sa > Si. Hence 
because of (17) and (18) we also have P 2 > Pi. By the risk of committing a 
certain error we understand the probability of that error multiplied by its 
weight. Hence the risk of committing an error of the first kind is given by TFiPi, 
and the risk of committing an error of the second kind is given by TFa(l — Pa). 
It seems reasonable to choose the value of X so that the two risks become equal 
to each other, i.o. such that 

(20) TFiPi = TFad - Pi). 


Hence using (17) and (18) we obtain the following equation in X 


( 21 ) 




6 


rlf ^ 


dt = 0 . 
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tJBitvg £i tablo (i{ tlut iionuul tlistribulinn. llii* nl A ttliit'li *“■ ?h< I'qtia- 
tion (21) can easily be fu\unl. For ir» " IF, the nf i2l > i*- m*.<•?< hy 


«« ~ iti 


and the critical region is given by Ihc mc‘((nulitv 


ir > 


ai 


t' Aff - <ti d- 


ft'* ‘ “■ rri rri 


6. Some results concerning the exact sampling distribution of the statistic I 
If Ni and are not large the solution giveni in .•^aiioli 1 eotitnit In- utid it 
is necessary to derive the exact sauipling diatributiim nl ( b<t 


( 22 ) 

Then 


0 /c 



•V1 5 

.Y, b ,V, 


‘ }i L 


(23) 


f/ =-- 




.Vj -h .Vj 

.Vi-Ys 


E 

t 



} 


where the variates si , ■ ■ , c,, an- iliMribnlcd mdeiK'ndcnlly of the mo ict , ■ ■ . 
Zf), the mean value of z, is equal to (i>. - n,) and (Ic utvariance 

, , r d I 1 - As 

between 2 , and z, is equal to o-,,. H is known that the mU of co\ .nninci-x e, 
distributed independently of the set (z,, ■ • . . z', , ■ ■ . c'„i and tbvicfon* tlic 

distribution of V remahiH nuehunged if inatcad of (0) wi< havi- 


(24) »o == fn A', t AA 21, 

n I . , 


where the^ variates are distributed independently r)f the (Z|. ■ • • , c„, 
zi. • • ■ . 3p), have a joint normal dLstrihutUm with mean values w>ro, ■ «,, 

and = 0 if a It is necessary to derive the distribution of 'l' under 
both hypotheses li\ and //s. In both cases the mean I'ulnes of Z) , ■ - ■ . z„ , 
2i, • ■ ■ , Zp are not zero. Instead of V wo, will consider tin* statistic 






which differs from V only in the proi)ovtionality faeltu'. Th.. dintri- 

butioM of U under the hypotheses Ih and /fj arc containc'd m special ciiscs in 
the distribution of the statistic 


(25) 


= E E s'^kn+llj. 


h+2 j 
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whero s,,- is given by (24) ;uid the joint distribution of the variutcss L,^ 
(t = 1, ■' • , /? == 1, + 2) is given by 


( 2 ( 1 ) 


_ 1 _ 

(2^)pTn+2)72 £r>.+"2 


1 J) r r ” “1 

^ ;,n t I —€j * f (^j,n+ 2" T | 

l-I La"t J 


n + 2 p 

X II S 


The ciuantitieB , ■ ■ , Sji, iji, • • • , ij,. are constants and a" denotes the de¬ 
terminant value of the matrix || v,, || . 

We will deal here with the distribution of tlie statistic V given in (25) under 
the assumption that the joint distribution of the ^•ariates {i = 1, ■ • • , p, 
(3 = 1, ‘ ■ , 71 + 2) is given by (26), 

In order to derive the distribution of V we shall have to prove several lemmas. 

Lemm.a ] Let II Xij II (i, j — 1, • ■ • , p) be nn arbitrary non-singular matrix, 
and let 


t,p — Xjj tje 




Let furthermore s'j be given by 


! 



a ~ 


£ tit', 


,a 


n 


• , p;/3 = 1, , a + 2). 


Then Xj s^b.D +1^7,n+i! — XJ j ^ b,n+ib.rt+2 > i.c, t/ic stattstic T ts tuvariatit 

It It 

under non-singular hnear transformations. 

Proof. A¥e obviously have 


(27) 


EE ^ita ^k,n t-l 


A -1 l-l . 


nH 2 • 


Furthermore we have 


(28) 

Hence 

(29) 

whore X,j = . 

From (29) we obtain 

(30) 

and therefore 


f 



y ^ y ) Xi^.XjiSfc. 

*-i /-I 


r I 

St, I 


= IIXwl 


Sii 


X.7 


qOJ II = 


= IIX’^ 


s'" = E Ex**x'^5"'. 

r -1 1-1 


(31) 
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Hence from (27) ivntl (31) we ishtsun 

J I ) X k I •* i 

The coefficient of iu.n-ulr.n i-* on the ri^ht, htin'i niili* of <32) irv Ki\oa hy 

(33) ErEEx*‘x".v”\..x,, - EE 

j t k t k 3 X ; 

Lemma 1 follows from (32) and (33). 

LEiiMA, 2 , The dislnhulinn uf T rnnantx nwhtvujrd ft trr utAxuntr- thu! (hr ro~ 
variance, malrix H ff.j jj is rqtml In the unit matrix, i,r. the jonif ih»fr^hui(im nj the 
variates l,^ (i ~ I, ■ •' , p; fi ~ I, • • • , u + 2 ) h (jum htf 

1 -if i‘ ^ S S fi *1 

(34) r ’L —1 0-1 . < J 

^ ^ ( 2 ^)p(»+n /2 

•where the constants p, and f, are fimclinns of the enmUtnls , • ■ <, ip , ni , ■ ■ ■ , 
and of the <r,/, 

I^emma 2 is an immediate eonmiuenec of Is-imiia 1. Henee wo have to derive 
the diatributioii of V under the a-ssuinpliou that the variates have the joint 
difitribution given in (34). 

Let Ri (f = 1, • * ■ , J)) 1)0 the point of the » +• 2 dimeiisitmiU t ’artohian ajmee 
with the coordinates Li, • • • Ix't R («!,•*•. Unm* and Q « 

»» t-3 

(«!,•■•, i)„+2) i)C two arbitrary points such that E “si’d d ami E % E '"s f ■ 

fl-i 

Denote by 0 the origin of the coordinate 8yntcm and let ?,.„*( Iw ih" projection 
of the vector 0/ii on the vector OP. We have 




(t ' ‘ 11 ' ‘' I p)> 


Similarly, the projection i(,n+s of the vector OP,- on 0(2 )« given by 
(30) r,-.„+i » E U»tis . 

tf-i 

Let R, {i = 1, ■ • • , p) be the projection of the point Ri on the rt-diinensional 
hyperplane through 0 and perpendicular to the vectotK OP and OQ. Denote 
the coordinates of P< by r,i, • • • , r,-,„+s reapcctii'cly and let 5*; in* defined by 

n+1 

E rigr^ 

3..... 


If we rotate the coordinate system bo that tho (a + l)“axm coincides with OP 
and the (n + 2)-axi8 coincides with OQ, and if Tn, • ■ • , denote the co¬ 

ordinates of Pi (i = 1, ■ ■ • , p) referred to the new system, then we have 

1 1 ” 

= - E ~ E ) and 

71 a*»l 

^*4-S n+S 

tip tip = ^E ^ip^ip • 
p-i a -1 


(39) 
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From (38) and (39) wo obtain 


n+2 


(40) 


vSn 


/ifl /|.n+1 + l 

/j-l 


n 


We will now prove 

Lemma 3. Lei V be defined by 

(41) = E Es‘^W<j,"+2. 


where , U,-n +2 and Su are given by t)ic formulae (35), (3tj) and (40) rceptr- 
lively. Let furthermore Ihe goint probability distribution of the variates l,g (i == 
1, • • • , p; /3 = 1, ■ ■ ■ , n + 2) be given by 


(42) 




(27r)^(” 


,r p n+i 
-i T V 




II XldUs, 


Then Ihe distribution of V calculated under the assumption that the quanlitirs 
ui, ■ ■ ‘ , u„+2 , Vi, • ■ ■ , u„+2 are constants and the joint probability distribution of 
the variates is given by (42), is the same as the distribution of V calculated under 
the assumption that the joint probability distribution of ihe variates t,^ is given by (34). 

Proof. If we rotate the coordinate system so that the {n + l)-axi8 eoineidc’H 
with OP and the (n + 2)-axi8 coincides with OQ, and if hi, ■ ■ denote the 
coordinates of P, (t = 1, • • • , p) m the new system, then and r,,„4 3 are 
given by the right hand side.s of (35) and (36) respectively. Furthermore 


Siy = 


X ^ litt tja 
a-l 


71 


Hence the distribution of V is certainly the same as that of V if the 
]omt probability distribution of the variates t,p (i = 1, d - 

1 , • ■ , n + 2) is given by the expression which we obtain from (34) iiy suli- 
stituting for t ,0 . Thus, in order to prove Lemma 3 we have merely to show 
that if the vanates t,p have the joint probability distribution (34), tlie variates 
1,3 have the joint probability distribution (42), Since the variates hi, • • • , h.n < a 
are obtained by an orthogonal transformation of the variates hi, • ■ ■ , (,,„43, 
it follows that the variates h'3 (i = 1, • • ■ , d “ L ■ • ‘ , n + 2) ari' inde¬ 
pendently and normally distributed with unit variances. We. have 

(43) h3 ~ 

v-i 

where hsy is equal to the cosine of the angle between the d-th axis of the original 
system and y-th axis of the new system. Since 

X3,?i+i = “Us and , 
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and suicc A'CIit) — DIiii'y — !> ■■■ < », ’ p.aiid/.IJ.»»+!! f,, it 

from (43) that 

(44) A'(lw) “ PiMi 4* f.i'j*. 


Hence Lemma 3 is pruvf<l. 

We wll now pro^■(' 

Lemma 4. Lei P hr a pumt u'tlh t/u’ nmniijifthi* ut, , w,,j ttrul (J a junul 

xuilk ihr caordinalm Vi, ■ ■ • t Vn*ifturli (humtijtvg 1. Dumk 

by Lp the flat space (letmninrd by the vreU/re lUii , • ■ ■ , llHp ■ JLi . - . /,.«^jl) 

and let P be the projerlitm of P on Lp and Q thr ptiyiclum «/ Q tm Lp . SientAr 
furifiemiorc by 8i the atiglr lirtuYcn the irriors 01* and OT*. by ft, ihr majh' Iniurtn 
OP and 0^, by 8% the angle Itclurrn (UJ and (XL by O, the angle hriwirn (Hi and l)P, 
andfirudly by ds ihe angle hdineni OP and Thru Ihr rtatidje T tPhnnl in (, 11) 


is equal to 








0 Oi 

Ot j 




■ 5i On 

OlJ ; 

(45) 


V - 

„ ' '^*** 

OjS 




On 

«IS 




Jou 

0«' 

where 





(40) Oi = 

= cos* 6i ; Oi 

» cos 

o[ cos e ,: 

5, ^ 


co.s“ 0i 

s 

— fli ' 

- 6? 



an != • — 

’ll 

, On “ 

(47) 


7^ 




and ttn = 


(’((«* f/j “ rti 


cos fli eo8 6t coK — ai «s — 5j ?>, 


Proof. If we rotate the coordinate aystera in such a way that the (?i -f 1)- 
axis coincides with OP and the (n + 2)-axi8 coinc-ides witii (HI and if 
ill , L'.n+a arc the coorduiates of P, in the new syatein, then 

tla,ip. 

Bii - , 

n 

According to Lemma 1 the statistic V is invariant under linear traiwforiimlions 
of the variables Lj. Hence f is also invariant under linear tmtwfumiationB of 
the variables . Thus the value of remains unehanpiwl if the jjoints 
Pi, • ■ • , Bp are replaced by arbitrary points Pi, ■ ■ ■ , P'„ of Lp aohjeet to the 
condition that the vectors OPi, ■ ■ • , OP*,, be linearly indejwuident, Hence 
we may assume that the vectors OP*, > • • , 07fp are pcr])ondieuIar to each other 
and lie in the intersection of Lp with the n-dimeusional flat space which goes 
through 0 ^d is perpendicular to OP and OQ. Furthemrore we nmy osaume 

that Pi = P and Bi ~ Q. Then OP, is perpendicular to OP, OQ, OPi and OPs 
(r = 3, • • ■ , p). 
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The statistic V can obviously be written in the form: 




0 il.n + l 

fp,n4-l 





fi,n+2 §11 

• ■ • Slj, 



(48) 


ip.n+2 S,>1 

• * • Spp 





§11 • • 

' Sip 





Spi - • 

• Spp 



Because of 

our choice of the points Pi, • 

, Rp , we 

have 


(49) 

t. 

,n+l — b,n+2 

= 0 

(f = 3,. 

■ ■, p) 

and 







nl-2 





(50) 

U01,» =0 if 

1 ^ J 

(i = 3 

, • • •, p,y = 1, • 

■', p). 


0 

h.n+1 

Si.n+l 

h.n+2 

Sll 

§12 

h , n +2 

§12 

§22 


§11 §12 
§12 §22 


, ^2, n+X 

II 

.«+2 = 


From (49) and (50) it follows that s,, = 0 for i j except sia which is not neces¬ 
sarily zero. Hence V reduces to the expression 


F = - 


For any two points A and B denote the length of the vector AB by AB. Since 
asii + (<i,n+i)^ -b (ti.n+s)^ = OP^, usii "b (tj.n+i)' -b (ti.n+a)'* = OQ'' and nsu + 
iirn+iij.n+i + k.n-i-ih.n+i = OP-OQ-oos ds, wc Can easily verify that Su = an, 
§12 = ai2 and §22 = 02a ■ Hence Lemma 4 is proved. 

The angles o[ and Q 2 can be expressed in terms of the angles 61 , 0% and ^3. 
In order to show this, let us rotate the coordinate system so that the first p 
coordinates lie in the flat space Lj, defined in Lemma 4. Let ui, ■ ■ ■ , Un +2 be 
the coordinates of P and v[, ■ , the coordinates of Q referred to the new 

axes. Then, since OP = OQ = 1, we have 


cos 01 — -b 

cos 0 % = y/v'^ -b 




'+C; 


‘ > I 

_ n' Wl Pi -b 

cos 0i = 


I ' I 

.) XtlWl + • 
cos O 2 = 

Vu^ -b 


I f f 

* * + Vp 

I f ' 

"T" 

.. " ,2 ) 

' + Up 


' ' I 

U\Vi ' 


1 ' ' 
+ Up Vp 


Vu[^ '+ ... -b Zl'pVv'i* -b • • 


Hence 


cos 01 = cos 61 cos 0 s and cos 0 i = cos 62 cos 
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Introducing the nottition.s 

nil = cos’ 9i , nh - coh’ Oi and nh I'lw* f»j ftw fl|, 

Ave have 

tti - nil, fts - nij, bi - tiii, 
nil — nil -- nil 


flu = 


and 


an - 


an 

nxi — ml ~ mi 
n 


^h. •' mi ; 

nia(l ■“ nil — ntj") 
n 


Substituting the above values in (-15) we nbtiiiu 

V = —n ~i' ~ 

mi — 1 + nil + nij — tn, im 

cos fli cofl 9t eo8 flj 

” cos’ cos’ 9i cos’ Oj — sin^ /h sin’ fh * 


Hence, Lemma I can be written as 

Lemma 4'. Lei P bn a potnl wilh the roordinairit fli .•••,/#«,3 tind Q n iimnl 
mill Ihe coordinates t'l, ■ ■ , y»+j. Drnolr by I,p the flat uparr ikUrmiiml by the 
vectors QRi, , Clip and let ? he ihe projeclion. of P on and () (hr projection of 
Q on Lp . Denote furthermore by 0i the. nriffle briurnt ()/’ and 11 P, by (hr unglr 
between OQ and OO and by Oj the angle between OP and bO- Then Ikr sHn/isfir T 
defined in (41) is cf/iioi to 

If P is a pomt of the (n + l)-axiH and Q a point of the (» -f 2)-axia, then p 
is identical with the statistic F given in (25), Hence we obtain the following 
Geometric interpretation of the stalislie V defiiu'd in (25). If Bi denotes the 
angle betiveen the (n -f i)-aNis and the. flat spare determined by the veetons 
OPi, • • • ,0Bp, Bi the angle between tlie (a + 2 )-axi 8 and the flat apace Lp , 
and if O 3 denotes the angle between the projections of the last two coordinate 
axes on Lp , then the statistic V is equal to the right hand side of ( 45 '). 

Denote by S the 2(i -f l-dinumaional surface in the 2n 4 - ‘t-friniensional 
space of the variables ni, ■ • • . u„,j, I'l, - • • , u„t 2 det'med Ivy the following 
equations 

2 ^ Ii-t.2 n V J 

(52) 2 14^ = Ufl « 1; X/ w# i^i* “ 0. 

«~1 H-l o-l 

denote by C the 2n -4- 1-dimensional volume of the surface .S', i.e. 

(53) C = i dH. 

Js 
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ISiOw we will asaume that Ui, ■ , m „+2 , , ■ • • , v„ 4 s are random variables 

and the joint probability distribution function is delined as follows: the point 
(ui. ■ • ■ , u„ 42 , i>i, • • ■ , Vn+i) is restricted to points of S and the probability 
density function of S is delined by 


(54) 


€ ' 


Hence for any subset ^ of the probability of A is equal to the 2 n + 1-dimen¬ 
sional volume of A divided by the 2n -f- 1-dimensional volume of S. It should 
be remarked that the probability density function (54) is identical with the 
probability density function we would obtain if we were to assume that 
lii, ■ ■ • , Mn+ 2 ) wi, ■ ■ - , are independently, normally distributed with zero 
means and unit variances and calculate the conditional density function under 
the restriction that (ui, ■ ■ ■ , Un+i, Vi, • • , yB+ 2 ) is a point of S. 

Lkmma 5. The probahiliii/ distnbidion of V defined in (41), calculated under 
the assumption that the joint probability density of the variables Ui, ■ ■ ■ , Un-\- 2 , 
wi, • • • , iin +2 ti^ (i = 1, • • • , p; = 1, • • • , n -h 2) is given by the product of 
(54) and (42), is the same as the disinbidton of the statistic V calculated under 
the assumption that the variables t,s have the joint probability density function given 
in (34). 

Lemma 6 is an immediate consequence of lemma 3. 

Lemma 6 . Let Lp be an arbitrary p-dimensional flat space in the n + 2 dimen¬ 
sional Cartesian space, and let Mp he the flat space determined by the first p co¬ 
ordinate axes. Assuming that the joint probability density function of u^, vg, 
h? (f = 1, • • • , p; j3 — 1, • • , n 4- 2) M given by the product of (64) and (42), 
the conditional distribution of V calculated under the restriction that the points 
R\, • ■ ■ ,Rp lie in Lp , is the same as the conditional distribution of T calculated 
under the restriction that the points Ri, , Rp ho in Mp . The point denotes 
the point with the coordinates hi, • ■ • , h.n +2 

Proof. Let P be the point with the coordinates Ui and let Q be 

the point with the coordinates vi, ■ , v„+i Let us rotate the coordinate 
system so that the first p axes lie m the flat space Lp . Denote the coordinates 
of P in the new system by ui', • ■ , u„^i, those oiQhyv'i, ■ ■ ■ , v„+i, and those 
of 72, by , • • • , ^ p). Let S' be the surface defined by 


(55) XUfi' = = 1 and = 0. 

It is clear that the surface S' is identical with the surface S defined in (52). It 

is furthermore clear that if the joint density function of ^tl, • ■ • , Up+i, vi , • • , 

(Is ( f f / 

Vn-[ 2 is given by ^, the joint density function of u[, 

is the same, i.e. it ia given by It can readily be seen that for any given set 

of values Wi, ■ - ■ , a (.+2 , Wi, • , v'„+i the conditional joint probabihty density 

of the variates is given by the function obtained from (42) by substituting 
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t',fi fov i,fi, i4 for 1(4 and rj for ('« . pniviclcd that fttr any ifivon w‘t nf 
valueH ui, , I(„^2, I’l, .i-'nts the joint t-onditioiuil tli^trillllti(Hl of tin* 
variates <,p is given by (42) Hence, if the joint distribution of hi , ■ • , , 

ui, • , i'„i3 and t,4 (i - 1. • • ■ . 7); "• 1. ■ ■ • , n + 2) is gnen by th(' imKlnet 

of (54) and (42), the joint jirobahility density function of tin* variates iig , cg , 
(t = 1, • ■ • , 71; d - I, ■ ■ ■ . n d“ 2| is otitained from that <if 7/,, , t,g iiy 

substituting i8' for M and <,4 for l,^. 

According to fycmina 4', P' can lx* exprivwd us a function of flic niighw (7) , 
02 and 06 defined in Lemma 4'. hiach angle. Ol ik ~ 1, 2, 8) can bt* exinr.sMHl as 
a function of the variables 1,4, ua, c/?. It is obvious tliaf the value of 04 remains 
unchanged if we substitute l\a for bn, a# for u» and 1*4 for C4 . lienee also the 
value of F ivraainB unchanged if we substitute I,a fm t,a , Ua for and 14 for 1)4 . 
Lemma 0 is a consequence of this fact and of flic fart that the joint probability 
density of the variabw i\ay ii'n and 1*4 is ulentieal with that of the variates , 
Ua and W4 . 

Lemma 7. Assuming that Ihr johii prohiilnlity distrilndinn 0 / tht cnrinlca 
Mfl, 1 I 4 , t (4 (i = 1, ■ • = 1, ■ • ■ , a + 2) IX given Inj tin pmlurt of (54/ and 

(42), the ccmditxmalpnni probahiLily ilislrihutiim of iq , ■ • • , ««. (j, i>i , * • * , ly <7 , 
calculated under the rcslricHon that the painltt Ut -- (t.i, • • • , /r.n.j) (i - 1 , * • • . p) 
he in the flat space determined by the Jird p caordimte (urcs, is gilrti hy 


(50) 


I 


1 " + 3 r 

-s 2 ; 1) (jtiq+fi*.,)* 

e r-pi 1 .-1 

I '‘I'd J*. 


/(«i, ■ • •, M,,», Cl, • • • , i\,.^)dS 


-5 £ S 

e /Oil , • • ■ , «.,(*, c,, • • • , Cm*) i/A* 


where S denotes the surface dejined in (52), and /(iq iq , f(„ 43 ) 

denotes the expected value of 


(57) 


jcn ••• 

\ 

n„ 

|r*i " 

1 » 

rtp 

j * ' * 



(r,i == £ Utf^ 


calculaled under the assumption thal the joint dislrihnlion of the varialcs t,a is giwn 
by (42). 

Peoof. Denote by Ri the projection of /(, on the flat space deternumal liv 
the first p coordinate axes, i.e. R, = (t.i, • • > , t.p , 0, • • • , 0). Ix*t 1, he the 
length of Ri , and let!, be the distance of Ri from the flat sjaiee cleterinined by 
the vectors ORi , • • • , (i = 2, ■ ■ • , p). Then, os ia known, 



where ru = . 


(f fi ‘ ' I p)t 
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We introduce the lunv variables 


(59) 



(t = 1, • ■ ■ , p, 7 = p 4- 1, • ■ , a -f 2). 


Then the joint probability density function of the variates up, , ity 

(t = 1 , • • • , p; )3 = 1 , • • ■ , n + 2 , a = 1 , ■ • . , p, 7 = p + 1 , • • • , u + 2 ) 
is given by 


(bO) 


(^1 -sF S s 

; . ' . . fi “L;*-! a-i i“i 

C(2Try<-"+^>i‘^ 


n+2 
7-7) ^ I 


X (iind^'.)(n 

t a * T 


Substituting zero for tty (i = 1, • • , p, 7 = p + 1, ■ , n + 2) in (CO), we 
obtain an expression which is proportional to the conditional joint probability 
density of the variates , rj, im (^ = 1 , • , -a + 2 , f = 1 , • ■ • , p, a = 1 , 

■ ■ , p), calculated under the restriction that the points /f, (f = ], • - , p) 
fall in the flat apace determined by the fii-st p coordinate axes. Hence this 
conditional density function is given bj' 


(61) 


vll.,,I,(u. 


■“2F ^ ^ I YT* TT 

X e L.-i =-i -• dS n n 


dlit 


wheic A denotes a constant The conditional distribution of the variates 
itfl , (j3 = 1, • ■ , 71 + 2) is obtained from (61) by integrating it with respect 

to the variables t,a {i = 1, ■ • , p; a = 1, • • , p). Becaii.se of (58), we see that 

the resulting formula is identical with (56). Hence Lemma 7 is proved. 

Lemma 8. Let mi — Ui A- •• A- Up ] = v\ -\- • 4- , and 

Vh = UiVi 4 - • 4 - UpVp . If the joint distribution of the variates ui, • , Un (.», 

Vi, ■ ■ ■ , v „+2 is given hy (54), then the joint distnhution of ini , m 2 , ms is given by 


B 


(62) 


•\/ 7 rii 1112(1 — mi)(l — mf) 


~ Fp(rni)Fp{m2)^„ F„+2pp 


ji+!it-p(l mi) 


X I 2..,)(1 ■— 1?l2)4*,if2 p 
where B denotes a constant, 

I 


( 


— ms 

^^(1 ~ mi)(l - Ilia) 


(63) = 






y/irP 


dnii dnis dnis 


..yzy _ ii ,i-.iK~s)i 2 


Phoop. Let m'l = ul+i 4- ■ ■ • 4- Wn-i:. ms = 4- ■ 4" K+i, 
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7 n, = + • ■ + , Vi, . and^ 7«. ^ . 1 ir.st «c 

calculate the joint tiisirilnition of nii, tth . vh V'l , vii, wis under ihe aHf.uiiiplinn 
that Ui, • ■ ■ , Un+i, i‘i. ■ • • , arc nonnnllv inilcpcmlcntlv disteiltufcd wifh 
zero means and unit variances. This join! disfrilmtinn is (j;iveti In' 

Fp{m\)Fp{nh)^,,(in,)h\,i ^{ihj) 

(fii) , , , , 

X 4'„(j .p{fn,) iliHi ih/ij fir/i, t!m, thif dnii. 

Hence the joint dintrihution of nii, m*, ni», >?ii , nia , m, ia given by 
Fpivti)f‘'v(.nh)^p( p(m5)/'’...; pirn,) 

, V mi nil mi in, \V »ii m/ 




ditii ilm-t dm, elm I tinii <lm \. 


The required conditional distrilnilion of mi, Wa, m, is etjual to tlie etiiiditionHl 
distribution of m,i, ma, nij ohUuucd from (he joint diet rii nil ion ((151 uiuier (he 
restrictions Wi + m'l - 1, m; + = 1 ami nij + m[ 0. lienee if in (tin) 

we substitute 1 — wu for mi, I — mj for mj and — nij for m', i^e obliiin an ex¬ 
pression pr,oportioiuil to the conditional diKtriinition of m\, Vh . m ,. 't’hiK proves 
Lemma 8. 

Lemma 9. For any poini (m , • • , ii„ c , la , • • • , r„ d) nf lUe mtrfnrr. .S' drjinril 
in (62) the expected value af (67) (ralc.ulaled under the mmimplum (httl (•12) in the 
joint distrihidion of ttn) in a function of mi mt , and m, only, lehrn mi , and m» 
are defined in Lemma 8. 

Proof. Let || \„g || (a, d = L ■ • • , ;>) he. an orthogonal nnatrix such that 


Uf 

- . / 2 ' ■ , J O = 1, 

V «1 • • • - i - Un 


Ufl 4" Xwfl 




(/3 = I, 


{Uft -f Xud) 


where 


S (oi = 1, .. , p). 


( 68 ) 
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'I'lieii thu variates t\a aic independently and normally distributed with unit 
varismees. Since for any point of S, E(t,„) = p.Ua + f.ra , we have because of 
(GG), (G7) and (G 8 ) 

EiUy) =0 (f = I, • • • , p, 7 = 3, 4, ■ ■ • , p), 

E{(n) = <pn(ini, vit, ?«*), 
and , mi , m 3 ) 

Hence the joint distribution of the variates (f = 1, • • ■ , p; a = 1, ■ ■ , p) 
depends merely on mi, m 2 and m 3 . Since r._, = UJ.,^ = the ex- 

a-®l 

pression (57) can be expressed os a function of the vaiiables Hence the 
distribution of the expression (57) depend? merelj" on the parameters mi, m 2 , 
and m 3 . This proves Lemma 9. 

The main result of this section is the following 

Theorem. Lei V he the stalisUc given in (25) and Jet the joint distribution of the 
variates (t = 1, • ■ • , p; ^ = 1, • •, 71 -1- 2) be given by (34). Then the prob¬ 
ability distribution of V is the same as the distribution of 


(G9) 


_ m3 __ 

^ ml — (1 — mi)(l — m 2 ) 


'mheie the joint distribution of mi, m2 and lUi is equal to a constant multiple of the 
product of the following three factors: the expression ( 62 ), the exponential 


giimi2p?+2.,.,Sp.r.+...2Srp expected value of 


\j — S t,a ) • 

a-l / 

The expected value of (70) is calculated under the assumption that the vanales 
are normally and independently distributed with unit variances and E(Ua) = 

V V V 

HiVa (i = 1, • • ■ , p; a = 1, ■ • ■ , p) where '^ul = m^,'^vl = m 2 and VaU^ = 

a—1 a—1 tf—1 

ms. The domain of the variables mi, m 2 and m^ is given by the inequalities: 0 < 
mi < 1; 0 < m 2 < 1; — “v/mim2 ^ m 3 <'s/minh ■ 

PiiooE. First we note that the expected value of (70) is a function of mi, 
m 2 and 7113 only. Jjet P be the point with the coordinates ui, • • , u„^ 2 , and Q 
the point with the coordinates vi, • • , v „^2 ■ Assume that the points /fi = 
(^ 1 , ■ • , L,n-i- 2 ) (f = 1, ■ • ■ , p) he in the flat space determined by the first p 
coordinate axes. Assume furthermore that uiVi -)-•'■+ aft.|. 2 r „+2 = 0 and that 
the lengths of the vectors OP and OQ are equal to 1. Then 

cos ?! = V'mI -t- • - ■ + itp i 02 = V'ul -b • • • -b 

and 



cos 03 = 


UiVi -b • • • + Up Vj, 


V' 


2 t 

Ui + 


-b Wp Vvl -b 


+ 


V 
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1C)2 


whero 6 i deiKitc.s the ()/* niul Uu* iiaf rijiniM* Lj, tictrriiiiiifd Iiy 

vcGtora 0/?i, ■ ■ • , 0/^p ; 6- (Icnotc,*' thr anglt' Indwren (K^ atui /,,,, ami th 
the angle between the iimjeetlimH of ()/’ and (IQ on Lp , AecMnlniK tf( 

4' the atatifitic V delirn’d in Ml) ia etiual to 


(71) 




eoK Oj ('(IS (It e(w flj 

(‘ok’ 01 COM* 01 ens‘ fli — nin® atii^ 0! 


mi 

ml “ (1 -- Ml,)(I - m,) 


where 

(72) ?«! == C0S“ 01 == lil + > • + «p . 7/lj » Cl)a“ 0a -* !•; d“ ■ • • + t'l, 

and Mij - coK 0i ccm 0j ens 05 y,f, -j~ .. f. , 

It followa from Ijwnmaa 5 and 0 that the distributum of T in the wtme a-a the eun- 
ditional difitribntion of T caUadated under llii' aasniuption that tlie tuunasditiuim! 
joint probaliility density of the variales ug, vg and i,g in given by the priKlnd of 
(54) and (42) and under tlie rcstrietion that the points if, (f - !,•••, />') fall 
in the flat space, determined liy the firsL p eoordiuale axes. Sinee 

I n h2 p 

2 2 (»<UT+fi't)’ . 

e ‘"I IS a constant multiple of 


from Lemmas 7, 8 and 9 it follow.s readily that llie, joint eomlitional distrihntion 
of mi = + ■ • • 4- i4 , wij = ^ ^ ... 4. 

equal to a constant multiple of the pnaluet of (02), (711) and the exjH‘cted value 
of 70. This proves our theorem. 


It can bo shown tliat the variates mi, mi and nij im* of the onler 
probability sense. Hence 


1 

n 


in the 


(74) 


_ 

^ ml — (1 — mi)(l — nh) 


= nmj(l + e) 


where e is of the order ^. Hence we can say: cvm for mofieraicly large n the dis- 

tribuhon of the slatislic V is well approximated by the disLribulion of rim?, where 
the joint duLnbution of mi , m-i and ms is equal to a eonslanl muUiple of (he prodwl 
of (62), (73) and the expected value of (70). 

If a + 2 - p is an even integer, the expected value of (70) ia obviously an 
elementary function of mi, mj and »is. Hcnee, if a + 2 — p is eV'Cn, the 
joint distribution of mi , m'> and mj is also an elementary function of mi, mi and 

m3. 

If the constants p, and f, (f = 1, • ■ • , p) in formula (34) are equal to ssero, 
the expected value of (70) is a constant and the joint distribution of mi, ms and 
ma is given by (62). 



ASYMPTOTIC DISTRIBUTION OF RUNS UP AND DOWN' 

By J. WoLPOwirz 
Columbia Universiiy 

1 , Introduction. Lot ai, Ch, • • • , osn be any n uncniual numbers and let 
jS' = (/ti, Ai, ■ • ■ j An) Ire a random permutation of thorn, with each permutation 

having the same probability, which is therefore Let B be the sequence of 

signs (+ or —) of the differences /q+i — A. (f = 1, 2, ■ • ■ , n — 1). Then R 
is also a chance variable. A sequence of p successive + (—) signs not imme¬ 
diately preceded or followed by a -f (—) sign is called a um up (down) of length p. 
The teim "run” applies to both runs up and runs down. As an example, if 

S = (46235), then in = (-|-h +) there are three runs, one up of length 

one, one down of length one, and one up of length two. 

The purpose of this paper is to establish several theorems about the limiting 
distributions of a class of functions of runs up and down. These results are 
applicable to certain techniques which have been employed in quality control 
and the analysis of economic time senes. They are also shown to apply to a 
large class of "runs.” 

2. Joint distribution of runs of several lengths. Let r,, be the number of runs 
of length p in and r'p the number of runs of length p or more in R Then r, 
and r'p are chance variables. The expectations AJ(rj) and E{rp), the variances 
(r^(rp) and o-^fr^), and the covariances airpiTp,) arc given by Lovene and Wolfo- 
witz [1]. They are all of the order n. Let 

_ ~ 

Vu ’ 

^, _ t'p - Eir'p) 

Up /- ' 

V n 

Our first results are embodied in the following theoienv 
Theouem 1 . Let I he any non-negalive integer The joint distribution of 
yi I '' ’ } yi 2/(M-i), approaches the normal distribution as n —> <x>. 

We shall give the proof for the case 1=1, bul. it will easily be seen to be 
perfectly general 

Let Xpi = 1 if the sign (-1- or —) of A.+i — A. is the initial sign of a run of 
length p. and let Xp, = 0 otherwise Let lOpi = 1 if the sign of A,-|.i — A, is the 


' Part of the results of this paper was presented to the Institute of Mathematical Statis¬ 
tics and the American Mathematical Societj'' at their joint meeting in New Brunswick, 
N J., on September l.L 1943. 
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1 . woi.Kiwn.' 


initial sign of a run of length p or more, anil let u'p, - 0 oLhcrwif*!*. Let 
lUpn = 0. Then 

It 

n « 22 -Tn . 


ri^twu. 

i-i 

Now write a = n\ IS = n\ and consider the pi sequences 

/t(j.1)0+1, /t(,.i)o+5, ••• , li)« (J “ L 2, , li). 

(Strictly speaking, we should employ the largest inh'ger in ir. Since what is 
meant is clear and since \vc are, dealing with an asymptotic jjrniH^rty, wii shall 
omit this useless nicety.) Let Xp, and Wp, have the. same dethulioiiM relative to 
each of these sequences that Xpi and v>p, have relative to tli(‘ .‘ie«inenee N. The 
accented and unaccented ri’s and w’s arc not always the .siinu<, hecnusc the 
partitionmg of the sequence N sometimes breaks up runs and creates otliera. 
Thus we might have Xpa = 1. but Xpa always ~ 0. 

It is easy to see that there exisUi a positive mimher tl such Hint 

ft 

22 I Xw ” 3Cu 1 < dfi, 

n 

X) I W)j< - I < dff. 


If, therefore, we define 


we have 


rt 


22 Wu - B{.x'u)] 



n 



I 2l - J/l I < 


2 ^ 
V n 


I ~ I/* 1 < 


2dd 

•\/ n 


d& 
V n 


=■-^0. 


and 



HtINS UP AND DOWN 


1(15 


Ilonco, if the joint limiting distribution of Zi and Zs is normal, so is that of y\ 
and y 2 . 

The chance, variables 


11 

ja 

E 

/ 

37ii 






11 

■s. w 

E 






(.7 = 1 , 2 , • ■ ■ , ; 3 ) 


i < ja), depend only on the relative magnitude of the elements of the sequence 


not upon the particular values which the elements take, and all permutations 
of the sequence have equal piobability. Clearlj” n, and are independent, in 
the probability sense, of riy and {j ^ /), because of the definitions of Xu 
and w'ii . (However, rjj and r'i, are not independent, because x'u and wi, cannot 
both be 1) From the results of [1] it follows that for sufficiently large n the 
absolute value of the correlation coefficient between ?'ij and ri, is less than a 
number smaller than 1. By the methods of [1] it can easily be shown that the 
ratio of the fourth order moments of and rjj about their means to the sqiiaie 
of the variance of either, is bounded for sufficiently large n. Plence by Lia- 
pounoff’s theorem (see, for example, Cramer [2], Uspensky [6]), zi and zi are 
jomtly normally distributed in the limit. Hence so are i/i and yl and the theorem 
is proved. 


3. Generalization of Theorem 1. Examination of the proof of Theorem 1 
shows that it rests on the following two properties of runs up and down. 

a) Partition of the sequence 5 into subsequences affects at most d runs in 
each sub-sequence, where d is a fixed positive number independent of n. 

b) After partition the totals of runs of each length in any sub-sequence (the 
definition now relates to the subsequence) are independent in the probability 
sense of the totals of runs in any other subsequence, and satisfy some condition 
(such as the Liapounoff) sufficient to make the components of the sum of the 
vectors jointly normally distributed in the limit. 

Hence if we adopt other definitions of runs which meet conditions (a) and (b) 
above, the total numbers of each of these various kinds of runs will be in general 
jointly asymptotically nonnally distributed. For example, if Sp and Sp bo the 
numbers of runs up of length p and of length p or more, respectively, and if 
tp and t'p are the same quantities referring to runs dovm, then, with I and k any 
positive integers, 


s<t+« > 


^1,^2, ■ ■ • , Si , 


h ,U., ' • ■ 



lOG 


WOtKtmiTZ 


are jointly aaymptolii'iillY iiovumlly distrilnitHl. flowcver, if inn f" itn'liitlftl 
in this set, since 

J''i — ifi + Sa + • ■ • + S( + •Scud 


and 


(, t= -f. /j -j. 


differ by at most one, tho limiting distiUaition is dcfcimf'mtn, i.c., its (’(ivniiniu’c 
matrix is only semi-delinite. 

As another example, if we define a bizarre rtm as, say, Uie orcnirrenee of a run 
up of length 5, followed, 17 eleinciihs later, by a run down of length M, then the 
nnmlrer of runs of this type is asymptotically normally distrilmtcHl with expecta¬ 
tion and variance of order n. 


4. Additive functions of runs of all lengths. Combining tlic nnmberH of nui.s 
of all lengths greater than a given length generally invoh’ea a los.s of information. 
The following theorem on additive functions of runs up and down may be of 
general inteiest and of utility in avoiding thin undesirable .sitiuition, 

'^Tiieohem 2 . Lei f{t) he a fuhcHon, dejiued for (dl poaitirr tniri/rni ru/mw nf t, 
which fulfills the fallowing canditims: 
a) There exists a pair of positive integers, a and h, such that 


(bl) 

b) 

(4.2) 


/(a) ^ « 

m b 

for any ei > 0 there exists a positive integer A"(«)) such Hint, for all n > X(eO, 

S 1/(f) I »(»■.•)< «1 a 

>“X(n) 


where a, of course, has the same meaning as in the preceding secHons, Let F(>S), 
a function of the chance sequence S, be defined as follows: 

(4.3) F(S) = 'EV(f)ri . 


Then the distribution of -- 

ffte(<S)l 

n —1 00. 


approaches the normal distnbuiion as 


As an example, lot f(i) s= 1, Then /'’(/S') ss r(, whose limiting distribution 
is normal by Theorem i. 

This theorem is the exact analogue of Tliourom 2 of [3] and the proof of the 
latter carries over without difficult changwi except in one imimrtant respect, A 
difficulty in the proof of the theorem in [3] lay in proving Ijcmma 4, and this 
lemma has to be proved completely anew. We, shall limit ourselves here to doing 
just that. Lemma 2 of Theorem 2 of [3], whose only role was to help in proving 
Lemma 4, has no analogue in our present problem, but all the others do. It 
will therefore be siifldcient if ive prove the follovdng: 
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[.EMMA- There exists a constant c > 0, such that, for all n sufficiently large, 

( 4 , 4 ) AHS)] > cn. 

Cdiulition (a) of the theorem is impased simply in order that the result be 
not trivial. For, if (a) does not hold, wo have that 

fit) = if ( 1 ), 

and 

F{S) = /(I) S in 

= (n — 1)/(1) = a constant. 

Suppose that 

f(t) = ui + V, 

with u and d constants, and v 9 ^ Q. Then by Theorem 1 

F{S) = u{n — 1) + vr'i 
= vr'i -h a constant 

is asymptotically normally distributed with variance of order n Without loss 
of generality we may therefore assume that 

(4 6) f(i) ui + V. 

From this it follows that there exists an integer A > 2 such that 

(4.6) f{A - 1) + f{A + 1) 2f{A). 

Our object is to prove that /[F(5!)] is at least of order n. The basic idea of 
the proof will be to construct two sets, say Li and L 2 , of sequences S, such that 
the (same) probability of each is not less than a positive lower bound independent 
of n, and such that there exists a one-to-one correspondence between the se¬ 
quences of Li and those of Lj so that, if Si is a member of Li and S 2 the cor- 
lesponding sequence in La, 

\F{Si) - F{S 2 )\ > gVn, 


where y is a iiositive constant independent of n Tt is easy to see that such a 
constuiction would prove the lemma 

.shall call the siibHoqucnce (/i,, lit+i , • ■ ■ , /i.+w) of S, a run of type Ti 
or simply a run Ti (the notion will be used only for the proof of this lemma) 
if the following conditions arc fulfilled; 

(4.7) each of the sign.s of Qi,+i -■ h,) and (/i,+a+i — Ii.+a) is the initial sign of a 
run of length A. 

(4.8) if i 7^ 1, the sign of (/i, — h,-i) is not the final sign of a run of length A. 

(4.9) if f -)- 2A 9 ^ n, the sign of {K+^a+i — K+^a) is not the initial sign of a 
run of length A. 



j. woi.fowit:5 


IfiS 


(4.10) after the tranKformatinii H, whirli inteu-hiiii^i^h /',,i i aiKi 

operated on the nm, tlu- sign of f/t.a - h.) is tin- initial sign "f a rini of 
lengthA - 1, and the sign of i - /;, ,,,J, in the nevi r.rrh'iing.K the 

initial sign of a mu of length .1 -h 1. 

Thus, with .1=2 and n = 7, if .S’ = (7l45:i2n), then H ^ i- T -I /I ). 
and (1 4 6 3 2) is a run Ti, for after the tnuiafornuiliou // has I teen aj)pliiai we 

have (1 5 4 3 2) Avhich gives (+-). The result of the oiHTatim, It on a 

i-un Ti will l)e called a run Tj. 

The number r* of nma Ti and the numher r** of runs 'l\ each Iium* expected 
values and vanancea of order n, hy eoimidemtions .similar to f law of fl j, 1 lenee, 
for an arlhtrarily small jjasitive £ there exists a positive eon.^tallt f/.surli that, frtr 
allnsufficiently large, the probal)iUtyP Ir* + r*» > f/n| of the set h*of Mspiemn- 
S which satisfy the relation in braces, is not le.ss than 1 “■ e. 

The set L* can be divided into disjunet .sots (familie.s) as follows: Ia‘t .S'fOl 
be any .sequence ti in L* which luw no runs 'A (any dtnibt alioiit (he exi.stence 
of such sequences will be .soon removed) and let r*(X(())) « nu lienee in > i/n. 
Operating with the transformation 11 on each of the m run.s Ti of «S’(0l wi* get a 
set S(l) of w different Hcquen('e,s for eaeh of which r'*' w?n-"l,r**“ 1, Operat¬ 
ing again with 11 on each of the pairs of mns Ti of the sequenee .s’tti) we get a 
set 8(2) of (j) distinct sc(iuence.s for each of which r* =- m — 2, r** -- 2, ete. 
The process stop.s with ^S'(w). wliieh contains a single scciueuee, for whieli f* f), 
r** == m. fhe set S(z) contains (7) different sequences for each of which r* - 
m i, r** = i. The union of the sets 8{i) (i = 1, 2, • ■ • , ni) will be eallwl tlm 
family whose generator is tS'(Q). The sets 8(i) are obviously disjuuet, Any 
sequence S in L* belongs to one and only one fandly. For if we operate on all 
of its runs A with II (which is its own inverse), we obtain the, generator of tin* 
family to which it belongs. This also proves the existence of secpienees in // 
for which r** ~ Q. 

Consider any family F whose generator is a stsiucncc for which r* = m > qn. 
It is easy to see that, when n is sufficiently large, the ratio of the total number of 
sequences S in the sets Lt and L* , where 

i«i| (m—v/m) 

L? = £ SO), 

»-0 

and 

L* - £ A’(t), 

(—Kirt+V'm) 


to the total number of sequences in F is greater than a fixed positive constant K'. 

We are now ready to construct Li and Ta ■ The set Li is the union of the seta 
ht of all the families in Z.*, and the set Ta is the union of the sets L* of all the 
families in L*. The probability of Li and of Ia is therefore not less 
than IK'{1 — e). The one-to-one correspondence is effected as follows: The 

subset s(~ ~ ^ of the set L* of any family is to correspond to the 
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subset 0, 1,2, of the set Lt of the same 

family. The individual sequences of either of the two subsets may be made 
to correspond to those of the other in any manner whatsoever. Any sequence 
i'll in Ai and its corresponding sequence & in L% thus differ only in the numbers 
of runs 1\ and Ti, but are identical in the numbers of all other runs. They 
differ in at least -s/m runs. Hence, 

I F(&\) - FiS.) \>Vm\ 2M) - f(A - 1) - /(A + 1) | 

> I 2/(A) - fiA - 1) - /(A + 1) I . 

This is the required result with 

g^Vq\ 2/(A) - /(A - 1) - /(A + 1) I . 

Hence the lemma and the theorem are proved. 

The remarks of section 3 also apply to Theorem 2. 

6. The distribution of long runs. Certain tests m use in quality control of 
manufactured products are based on the occurrence of long runs. Since the 
mean and variance of fp , for any fixed p, are of order n, it follows that the prob¬ 
ability that Tp 0 approaches 1 (vyith increasing n). In order to base a test 
on the occurrence of a i-un of length p in long sequences it is therefore necessary 
to make p a function of n. This function must be a suitable one, because if p 
IS, for example, of the order n, the probability that = 0 approaches 1; p 
should, therefore, be neither too short nor too long. 

The following theorem will help give the answer to this problem; 

Theorems. Let p vary mth n, so that 

(P+ 1) 1 ^ 1 

n K 

with K a fixed positive number. Then 

hm P{rp = i( = 0‘ = 0, 1, 2, ■ ■ •) 

n-+oo J 1 

i.e., rp has in the limit the Poisson distribution with mean 2K 

The pi oof will consist in showing that the moments of rp approach the moments 
of a Poisson distribution with mean 2K as n —> «>. This is sufficient (v. Misea 
[4]). 

Let a:, = 1 if the sign of /i.+i — h, is the initial sign of a run of length p, and 
z, — 0 otherwise. The piobability that z, = 1 is, by [1], Section [4], 

for all i with a fixed number of exceptions.” Write B = —7~r ,; 
(p + 3)! (p + 1)!' 

then 

_ P{xi = 1} = B + o{B), 

^ Since these exceptions (at the ends of the sequence S) have no effect on the asymptotic 
theory, they will henceforth be ignored 



170 


J. WOUKOWITZ 


aW) 


■where the symbol o(ii) lUPiuiH that lim =- f). Let i/, fi - 1.2, 


, /<S Ilf* 

independent chance variables with the ssirtu* tlistribnUon: /‘jy, 11 li, 

*1 

P{i/, = Oj = 1 — Then it i.s easy to .nee that Y -- 52 Ih htis in the limit the 

Poiason distribution with mean 2A' and that, its moments approueh the moments 
of the same Poisson distiihuticm. lienee it will be suHieii'iit to shou that in the* 
limit F and fj, have the same moments. 

• < 1 , are positive mleners, we have that 

= '/.5 ■ • • ?A.) 

= II m,) - 


If q,ai,ai, ■ 

■ ■ , and ix < h < ■ ■ 

(6.1) 


and 


(6.2) 

0 ^ ••• jrr 

Also 


(5.3) 

E{r‘,) « 


■cr,*) = A{j\i J'.j 
r H ni 

lS ' 




After expansion of the right member of (.5.3), we may replaee, in areord with 
(6.2), each of the non-zero exponents of the. x'.m by 1. I’he same oin'ration on the 
terms of the expansion of the right member of 



is valid in accord with (5.1). 

Let h < fj < • • ■ < r,, In the expression 

(5-5) ii’(x.,x,, • • • .T,-,), 


let g be the “weight.” A subsequence of consecutive in (.5.5) (it may conniKt 
of a single x) which is sucli that the indices of two consecutive x'h differ iiy leas 
than (p + 3), while the subsequence cannot be expanded on eitlicr side witiiout 
violating this requirement, will be called a “cycle.” Let c be the number of 
cycles in (5.5). By [1], Section 4, it ,r, and x, arc in different cyelea, 
i.e., U — > (p + 3), then x, and x, are independenUy dislrilnitwl. If, 
therefore, g = c, we have that 


(6.6) •. • X.,) = f[ £•(*.,) = *8’ + o(/P). 

,'-i 

If g > c = 1, we have, also from [I], Section 4, that 

E{x,,Xi, • • - X,,) < E{xi^Xi,) = o(B). 
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If g > r, and if there are two indices in the expression (5.5) which differ by less 
than V, then 

(5.8) Eixi^x,^ • • • Xi^ = 0. 

For Xi and Xj cannot both initiate runs of length p if | f — j | < p. 

Let us now return to the expansions of the right members of (5.3) and (5.4), 
in which the exponents have been replaced as described before. Let the weight 
and cycle definitions also apply to terms of the type 

(5.9) 

From (5.1) and (5.6) it follows that, in the limit, the contributions to 
and E(Y‘) of the sums of those terms for which g = c, are the same. Let W and 
W' be the sums of all the remaining terms in E(rl,) and E(Y^), respectively. If 
we can show that 


(5.10) 


lim IF = Urn IF' = 0 


we will have proven that 

(5.11) lim E{r\) = Urn E{Y') 

and with it the theorem. 

Let B = 0[/(n)] mean, as usual, that | S | < Mf{n) for all n and a fixed M > 0. 
The number of terms in IF' with fixed g and c {c < q, by definition of IF') is 
0(n°p’"'). From (5.1) the value of the sum of all such terms is 0(5''n'’p’~‘’), 
Now 

nB = 0(1) 

by the hypothesis of the theorem. From the definition of p, 

p = oin) 

and hence 


p5 = o(l). 

Therefore 


5Vp*"” = {nBYipBy-^ 

= 0 ( 1 ). 

Since q < I, there are only a fixed number of such sums. Hence lim IF' = 0. 

The number of terms in IF with fixed g and c (c < g) is 0{n°p^~‘). However, 
most of these are of the type in (5.8) and therefore vanish. Those which do not 
vanish are 0(n°) in number. Since g > c we have by application of (5.7) that 
each term is o(H'). Hence the value of the sum of these terms is o(n°B°) = 
o(l) Since q < I, there are a fixed number of such sums. Hence lim IF = 0. 
This proves (5.10) and with it the theorem. 
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It is posaible to generalize this result in a manner similar fo that nf Sectiun 11. 
The author is obliged to IV. Allen Walti.H who first dn*w hw attention ht prub- 
lems in runs up and down, and to Howard I^evene, who read the mami*<(Tipt of 
this paper. 
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STATISTICAL ANALYSIS OF CERTAIN TYPES OF RANDOM 

FUNCTIONS 

Bv 11. IIuiWlTZ, Ju, AND M. KaG 
ComeU University 

1. Introduction,. In solving certain physical problems (Brownian movements, 
shot effect) one is often led to the study of superpositions of random pulses. 
More precisely, one is led to sums of the typo 

( 1 ) m = £/(«- <,•)> 

where N and the i/s are random variables and a function P(0 ia given such that 
j^P(t)dl represents the average number of pulses occurring during the time 
interval A. 

We propose to give a fairly detailed treatment of those atatiatical properties 
of F{i) which may be of interest to a physicist and at the same time pay careful 
attention to the mathematical assumptions which underly the applications. It 
may also be pointed out that our results could be applied to the theory of time 
series. 

2. Statistical assumptions and the distribution of iV. The statistical aaaump- 
tions can be formulated as follows: 

1. The i,’s form an infinite sequence of independent identically distributed 
random variables each having p{t) as its probability density. 

2. AT is capable of assuming the values 0,1,2,3, • • • only, and N is independent 
of the tj’s. 

•3. If Af(A; W) denotes the number of those t/s among the first N, which fall 
within the interval A, then for non-overlaping intervals Ai and As the ran¬ 
dom variables Af(Ai; N) and ilf(Aj; N) are independent. 

We now state our first theorem.’' 

Theoiirm 1. Assumptions 1, 2, 3 imply that N is dislribukd according to 
Poisson’s law, i.e. 

Prob {W = r) = 

Ti 

where h = P(t) di. 


* For a different approach to Poiaaon’s diatribution aee W, PenLEa, Math, Ann. 113 
(1937) in particular pp. 113-160. 
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Our proof is based on consideratioiih of charaptoristii- 
be 1 if a: belongs to the interval A aird 0 otherwiw. I hut* 

d/(A;iV) -- 


Prom the independence of jl/(Ai; A") and A/fAi; A') it follou.** tlutt foi <'ve‘ry 
pair of real numbers f and jj we Iiave’ 


p|^exp jf ^ 


f S 

0X1) S '/'ai(h) 
I *”i 


A 


t'XP -.ITI <PAt{h) 

^ IfW t 


where E[x] denotes the mathematical expectation, or mean value, of x. Ix'ttinK 
q^r) = Prob (Af = r\ and using first the independence of *V and the f,V and then 
the fact that the f/s are independent and identically dislnbutefl wc obtain 


^ i7(r)(i3[exp (ffW'iiW + #a,(0)!1)'' 


( 2 ) 


r-O 


2 <;(r)(/';{cxi) (jCrKAlevp JiWAjCf)!)!''. 


r®»0 


An easy calculation gives 

Alexp = 1 + (e'^~ 1) I Pit) <11, 

Pfexp = 1 + {(•'" ~ 1) f p(f) df, 

E[exp + nM))}] = 1 + (e’* - 1) f Pio dl + (c” - 1) / viD dl. 

•>&l -'Aj 

The last equation follows from the fact that Ai and At do not tiverlap. l\ittmg 
^ = ri-r,x = l~2f p(0 dl,y = 1~2 [ p{t) ill, ip{,.r) « Xqir)/ we see tliat 

(2) yields the functional equation 

(3) <p(a; + “ 1) = <p(p:)viy)- 

One cannot ascertain that (3) holds for all real x and y. Fiiat of all the delinmg 

power series of ip{x) is not known to converge outside the unit circle and Hccondly 
it is not obvious that each pair of real numbers x, y betwc(*n — 1 and I is auch 
that non-overlapping intervals Ai, Aj exist for which 

X == 1 — 2 f p(t) dt and j/ == 1 — 2 f p{l) dl. 

Ja, Jaj 


‘ We use the symbol R and B[R] luteichangeably to denote the avcnigp (inatl)emut,icnl 
expectation) of R 
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However, if one restricts oneself to small Ai and As the functional equation (3) 
is seen to hold in a suffieiently small neighborhood of 1. This is sufficient (in 
view of the analyticity of ip in the unit circle) to detennme <p(x). 

In fact, differentiating (3) first with respect to x and then with respect to y 
we get 

= (p"ix +?/-!). 


Letting 2 / = 1 and putting <^'(1) = h we have 

v>"(x) = fup'ix), 


which yields immediately 

,p(x) = He*" + B. 

An entirely elementary reasoning (which employs the fact that He*" + £ must 
satisfy (3)) leads to the conclusion that B ~ 0, A = e“* which in turn implies 
at once that 


g(r) = e * 


fl ■ 


Finally, 

P(t) dt = E\M(N-, A)] = E (^a(4)] 

= ([ pit) dA e~* X) ^ = ft' f pit) dt, 

\j i, / r-O r I Ji 

and therefore 

f+“ 

/ PH) dt = h, Pit) = hpit). 

J—eo 


Since ft. is the mean value of N (i.e. N) we shall use N instead of ft. 


3. Fourier coefficients of Fit) and their statistical properties. In physical 
apphcations it is often convenient to assume that the “pulse function” fit) is 
periodic with period TiT large) and one might therefore restrict oneself to the 
mterval (0, T). 

It is furthermore assumed that both fit) and P(0 are sufficiently smooth^ so 
as to justify the formal operations on Fourier series performed below. Since 
we work in the interval (0, T) we assume that PH) = 0 for t < 0 and t > T. 

Expanding fH) in a Fourier series in (0, T) we get 

fit) X aM exp (ftoti), w* = 

— eo -I 

’ For instance/(t) ami P(i) may be assumed to be of bounded variation Actually, much 
leas severe reatrictions sufRce but in investigations of this sort far reaching generality would 
only impair the exposition 
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and thus 


where 


f’(0 ~ X) aMl>M exp (tofcO. 


bM ~ 2 «xi) (—iwi//). 


Note that 


E[exp (—tuOl - f exp (—iojt)p(0 

Jfl 




TJ,> 


[ exp {~iu>t)P{i) (It 
•*0 

I 

T ■'9 


a(w) 

> /" /'(t) 


r{ut) “ w(«) 


and put 


R 


jS[F(t)] = - £ o(w».)p(wfc) exp (i«*0 ^ f'Z, aMpM <‘xp (^Jh 

—«) -ii* 


(S) _ /-I 


2 cos - i9'c(wjk) 


xr = 


(^) _ ^-1 


V'^ 

X) sin (w*iy) - Rsiuk) 


rr = 


VR 

Thus remembering that R = f P{t)dt we may write 

Jo 


~ L aW(zf' - tTf’) exp 

V ^ 


or 


- irf’) exp M. 

We can now state the following: 

Theobbm 2. In the limit as R m each (and is normally distrib- 
vied vnth mean 0 and variance ^ + ic(2«jt) — 4c(2<os)). 

The proof, as usual, is based on the consideration of the characteristic function 
of Xi^\ 



We have 
iSlexp }] 
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= exp c(uk)S exp {-f}) g (^E |^exp 

= exp {-i^VN c(w*)) exp (-iV) expjw^'j^exp ^|]} • 

In deriving this formula use has been made of the facts that the i/s are inde¬ 
pendent and identically distributed, that N is independent of the i/s and that 
N is distributed according to Poisson’s law. It is now easy to see that as iV' —> <» 
the characteristic function of approaches 

exp {-(i -f- ic(2o)0)f"l 

uniformly in every finite ^-interval. This, m view of the continuity theorem 
for Fourier-Stieljes' transforms, implies our theorem. It should be mentioned 
that it is tacitly assumed that even though N = TpiO) approaches » it does it 
in such a way that the ratio p(w)/p(0) (and hence c(w)) remains constant (or 
more generally, approaches a limit). 

By considering the characteristic function of the joint distribution of 
and Xi^^( I fc 1 111 ) (or any other pair like, for instance, and Yi^\ in 

which case no restriction on A:, Z is necessary) we are able to prove 
Tseorbm 3. In the limit as the distinct Fourier coefficients of {F{t) — 

E[F{t)])/-s/ p(d) are normally correlated (i.e. their joint distribution function is the 
bivariate normal distribution). 

It is also clear that the higher correlations (i.e. between more than two coef¬ 
ficients) will lead to multivariate normal distributions with coefi&cients expressible 
in terms of Fourier coefficients of P{1). 

We do not state Theorem 3 in more definite terms because in the next section 
we shall give a more convenient and useful way of handling correlation proper¬ 
ties of our Fourier coefficients. 

4. Statistical structure of Fourier coefficients. Let us assume that P(t) > 
7 > 0 and that the Fourier series of P{t) converges everywhere. 

Expandmg ■\/P(t) in a Fourier series in (0, T) we have 

00 

VPU) = £<^(“1) exp (ioiii), 

—00 

and in particular (since p{i) = P(f)/N) 

_ 

= ::;7^ S crC"!) exp (iwiij). 
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We can now write 


bM = £exp {-iwktj) - S ^ 

1 A /A CXI) (i(«i - wrif,)\ 
" Vf ihc 1^1 Vpitf) 1 
1 


fA exp 

vm i 


=- /~K ^ + “<«) 

v j/9' I-A 

A A , A 1 Aexpri'w/ij) ^ . 


} 




1 ^(‘xp(iw(f/) 

^/M' VpUf) 


= jf Z) + 0 )k)<r(~ui) 

i*"*—« 

«« 

+ V^7' Zj '*’*) 

Put (r(w) « a(w) + t/3(u), note that by PnreevaVa relation 

<4 

p("t) = £ <*■(«* + wj)tf(—«j), 

l*^te 

and introduce random variables and Vl'^^ by mtmw of the formulaa 
rr(^) A— /rr> ( \ 

-VS?§Vp(« 


-Af <r(-'Wf)f. 


VI 


07) 


1 AsinCwit^) ,, . 

V 9 rSV.(« 


Thus 


hM = 3>(a,*) + V2’ E .r(«* + m)iUf' ~ iVf^)l 


and we have the following theorem. 

Theorem 4. In the limit ae ff ^3 the random variables Ui^\ U\^‘, Vi^\ 
Vf\ 72^\ • ■ ■ are independent and normally distribuied (fioch mth mmrt 0 and 
variance ^). 

This theorem can be proved in a manner exactly analogous to that of Theorem 
2 . We need only consider the characteristic functions of the joint distributions 
of U’s and V’s and treat them in the same way as wo treated tho charaoterisWo 
function of the distribution of a single X in the proof of Theorem 2. One thing, 
however, should be strongly emphasized. The proof of independence (in the 
limitasJV-»«)of I7r>and ([fl 5 ^ ] m 1 ), for instance, depends on prov¬ 
ing that 
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'I'hitj in turn depends esscuitially un the fact that N is distrifnited according to 
Poisson's law. 

In fact, 


mf' ui:'] = 



Vp{^-) ) Vplii) )\ 


J'a(wi)a(wm)- 


Hut 


/cos cos (wmi,)\1 

l\hi Vpit,)) \h Vp(« VJ 

' “iiffi J L^. Vpft)VRw J 

and finally , ' 

E[uf^ f7f>] = - l)r«(«,)aW 

Since for Poisson’s distribution = iV” + (iV)“ we get 

E[uf^ i/f’] = 0. 

Also the proof that E[ \ | *'] = i employs essentially the fact that N is 

distributed according to Poisson’s law. 

In view of Theorem 4 we can restate Theorem 3 in a form which is both useful 
and illuminating inasmuch as it describes completely the statistical structure 
of the b(aa)’8 and hence of the Fourier coefficients of F{t). 

Thbobem 5. For the purposes of finding correlations between the 6((j*)’s tt 
sufiices to replace each b{wh) (in the limit as M ^ °°) by its ‘'statistical representa¬ 
tion” 


te 

Tp(oik) + "s/r 22 a(uyk + ui)Ai, 

{ — —C O 

where A_j is the complex conjugate of Ai, Ao, Ai, A 2 , • • • a sequence of independent 
complex-valued random variables and each Ak is distributed in such a way that 
dk = arg Ak is uniformly distributed independent of Ak and the density of the prob¬ 
ability distribution of ) Aa | is 

2Ae-^\ (A > 0). 

Theorem 5 was proved under the assumption P(t) > y > 0. This assumption 
was needed to validate the convenient artifice of multiplying and dividing by 

Vp(ti)- 

However, even in the case when P(t) is not bounded from below by a positive 
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number (it is always inie that /'(ts > tM Thenrctiv .1 ri-tiiamf true, H cMuifi Ik* 
proved by direct l)Ut tedious con.sideratioiis sujJKe^'b-d m wiinji 2 , 

Theorems 4 and 5 can tu* easily exteruiiHl to the niM* uheu the all lui\e 

the same shape but may, at rfiiidnin, differ in rmij^riifiide In other words, 
instead of sum (1) we may consider the wtm 

V 

(4) m - E«,/(«“■ b). 

where the individual pulses are independent and a funetiori Pit, f‘i (s nivcn auidi 
that 

/ I -fr-At ^ t i t 

J P(t, t) dl dt 

is the average number of pulsea of “amplitude" between f and f f Jic tH-euning 
between ( and t + A/,. 

Theorems 4 and 5 vStill hold provided one replans- ihe Fourier cof-theients of 
P{t) by those of 

1 tP(t, t) dt, 

• L .«0 

and the Fourier coefRcionts of y/Pit) by ihoae of 

VQiD^^J^ t’F(e, Ode. 

6. Concluding remarks and summary. If one asHumea that tin* uuinber of 
pulses N in the time interval (0, 2') is constant instead of being a. random variable 
obeying Poisson's law, then Theorems 4 and .1 fail. Tlie failure is due to tin* 
fact that, for instance is no longer U, However, as T * r. the 

changes in correlation duo to assuming N couslunt become, negligible, tin the 
other hand if one assumes that the number of pulses in eacli of the time intervals 
(0, t), (r, 2t), • ■ ■ is fixed, the change.s in correlations beeome appreeiahle. 
This case can also be treated by the above methods. 

The case in which p(t) is independent of tune has been considered in various 
connections by Schottky, Uhlenbeck and Cloudsmidt and Rice*, 'riu-ir investi¬ 
gations emphasized the importance and usefiilneaH of the harmouie analysis 
of random functions. 

In conclusion we summarize our results for the case of time-dependent P(e, 0 


' W, Schottky, Ann. d Phys. 67 (1919) pp. 541-507. 

G E, Uhlenbeck and S. Goudsmiut, Phy%. Rev. 34 GOZO) pp. M5-161. 

S. 0. Rice, mimeographed notes on mathemaiiral analysis of random noise, as yel 
unpublished 

The authors are indebted to Mr, Rice for making his notes available to tliem. 
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by observing that in applications one may replace F(t) by its “statistical 
representation” 


(5) Em)] + vt e 


exp (acoiif), 


where 


OJt - 


2irfc 

T’ 


E[F{t)] = T E a(«i)p(t<)i) exp (ttoiO, 


»eo 00 

I fP((, t) di = E p(“)t) exp (lUfcO) 

J—aa j^M—oQ 

"" j// "" it£ 


and the Aj’s are normally distributed complex-valued random variables for which 

E[Ai] = 0, E[\A,\^] = 1, At = A.i 

Furthermore, for i > 0 the Ai’s are statistically mdependent. 

Thus 


F{t) - E[F{t)] ^ E H^^k) exp (iukt) 

60 

where the \’s are normally distributed complex-valued random variables obeying 
the relation 

E[\ X(oi)l=] = la((o)f f Q{t)dL 

*'0 


If Q([) is periodic with frequency ^ then it follows that X(ai') and X(&)”) are 

independent unless ai' -f w” or a' — w" is an integral multiple of wt,. 

Finally, we mention that Fit) ~ E[Fit)] is normally distributed with variance 
s(t) given by the formula 

s\t) = E[iF{t) - EiFit))f] = T E y{oik)M exp M, 

eo 

where 7 ( 0 )*) is the Fourier coefficient of Qit) and nim) the Fourier coefficient 
of fit). 
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1. Statement of the problem. (’HiiMtlcr lln* niulihnn *4 nm- 

pound of | 2 ;ul(l <luHt ul nuidoni nmunpia rniititnlily f*i i <4 l,<.f (he 

l)egf;iU'S 1)P (‘uiimeratnd ami lot thr pnanlun* bn tli“tnlm»iMn Iw JoihiWf*; 
the liret lu'KKar ia given a rnudiiiii {wirtion uf tin* guld; tin* Leggar a 

random portion of (he n'liiamtlt'r; • ■ and on ud itdiinmia. In ilo^ do'^enp- 
tion the phrase‘‘random ))orfion“ tK’eurh im inlinitf numUoj ol unji'-: ii m-ins 
reiiBouable to reciuire that it liuvo the saiin* inferpiefatmn eneh ‘iim* To he 
precise: let x, (J = 0, 1, 2, ■ ■ he the anioittif leceivisl hv the jth heggai, Ivcl 
the distribution of Cn Ite given l>.v a deiieity funelion /tsX!; 


(1) 

vi\) 

i 0, 0 < X f 1; 

(2) 


l; 

Jo 

(3) 

P(a < Xo < b) 

•= [ p{\) f/X, (1 ri » < b < 
0 


After the first beggar has received his idnw ainl the atnonnl of gold dn"! left ie 
Ii, (i.c. a;o = 1 — g), the value of a will he Uetwwn 0 and m. 'I’he uniformity 
requirement menlioncd above ineaiw that, the proportioti of ij that the .M'eond 
beggar is to receive is again determined !>>' the jtrobabilitv tletiMiy />: in other 
words the conditional probability that ri lu* betweam Kn and (\ f given 
that a;o = 1 - g, is p{X) d\. In symbols: 


( 4 ) 


P{ait < Xi < hii \.ro ~ 



f/X, 


Writing a = an, = bn, (4) becomes 

(6) P(a < Xi < ff\xo -= I ~ n) -= f dX. 

More generally I shall assume that the condiUonal jirobability ilisiribufion of 
Xn , assuming that after the preceding donationa there is left an sinmunl a. is 

given in the interval (0, n) by -- p (^). In symbols: 

M \m/ 

(6) P(a < a:,, < H Z = 1 - n) = [ % 0 S a < b ^ H- 

}<n Ja n \M/ 

This assumption completely determines (in terms of p) the joint efistributiorr 
of the whole infinite sequence jaio, Xi, Xi, >■•). Several interesting special 

182 



lUNDOM ALMB 


183 


questions may be asked about this distribution. For example: What are the 
expectation, dispeision, and higher moments of the a;,, ? What, similaily, arc 
the moments of the partial sum ~ More generally what are the 

exact distributions of Xn and of ? Will the process described really distribute 
all the gold, or is there a positive, probability that .some is loft even after every 
beggar had his turn? What is the rate of convergence of the series X/nSo ? 
It IS the purpose of this paper to answer these and a few related questions. 


2. Calculation of distributions. The n + 1 dimensional proliability density 
of the distribution of (a'o, aii, • • • , Xn) is given by^ 


(7) 


n 


1 2 -] 3 <» 



ll_\ 


in the region defined by Xj ^ 0, Xo + • ■ ■ + Xn S 1. For n = 0 there is only 
one term in the product and that one is equal to p(Xo), the region is defined by 
0 ^ Xo ^ 1. The formula reduces m this case to the definition of the distribution 
of Xo. The general case follows inductively by the use of the conditional prob¬ 
ability formula (6). ^For example: P(xo = Xo, .a'l = Xi) = P(xo = h)P(xi = 

From (7) it is possible in principle to calculate the densities of the distributions 
of Xn and of iS„ . Thus for example the density of the distribution of x„ 
is found by integrating out the X, with j < n from (7), so that 


( 8 ) 


M -/••■/ n 1 _ X,) 


■1 3 


where the integration is extended over the region defined by Xj ^ 0 (0 ^ ^ n), 

Hj^nXj ^ 1. Similarly 'Fn(<) = P(Sn < t) is given by 


(9) 


y n{t) — f ■ ■ ■ f TL1 Y' \ p (1 v i) 3 

•/ <1 1 ~ ^7 X-*- ~ Zj 3<3 A,y 


(0 S i ^ 1) where the domain of integration is defined by X, ^ 0 (0 g j g n), 
^3 t. 

Working with integrals of the type (8) and (9) is often greatly facilitated by the 
substitution m = SygiXj, (X, = 0 g f ^ n. The Jacobian of this 

linear change of variables is identically one. The domain of integration used 
in (0) is defined in terms of the ju’s by 0 ^ yio ^ Mi ^ ^ Mn ^ ^ 1, so that 


( 10 ) 


V„{t) = f dM„ r dM„-i ■ • • r dixo n j—i— V . 

^0 Jo Jo Ign 1 ^ M .-1 — Mi_l/ 


IA summation or a product extended over an empty set of indices will, as is customary, 
be interpreted as 0 or 1 respectively. Since throughout this paper only non-negative indices 
are considered, whenever the notation indicates a negative index the quantity to which it is 
attached is to be interpreted as 0. 
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Hc>nc!c Ihc tlcnmty of the* dirftrihution of ik 

y.i(0 = 

( 11 ) 


Jo Jo 


dfln- J 


r* tr 

, 1 i 

•'fl 1 If' » 


1 

— P‘, 1 



■ ■ Mi- 




‘l 


1 

P 

t 






For later purpow'H it ia tuorp {'onvf>nu'ii( In wt t n„ in (ll) atitl to cxpn'wH 
i'n(Mn) tis ‘1* multiple (ami ruit im utv iteraUsl} inP'Kral; then 


( 12 ) 


Vn{pn) II j 



} 


where the domain of intep;ratioa is dptined hy I) wt S ni f' •' ■ "S jfn-i S 
Hn g 1, The internals (8) and (12) are explieitly e\’!ilnafefi Ih'Iow for a speeial 
case. 

It is possible from (8) to lind the fcth moment «Uk”’ of , Atl’" m 

[ \iqn0^n)dK- Write 
Jo 

a* * jf* X*p(X) dX, fik = j[' (1 - M*P(X) tlx. 

Clearly flf*"’ is obtained from (8) upon multipliealion by X« lUid integration 
with respect to Xn. 


(13) Mi-’ -/•■•/ x‘. n 1 - 2,<,' (l - E-.. X,) *• • • • '®“ ■ 

It is advantageous once again to write p, = X; ■ 'riie remilting integral 
may be written in the iterated form as follows: 

rl 


(14) 


= f duo f dpi ■•• [ tlfin II ^ 

Jo J)10 Jp»-I <1^n 1 — 


/g,- “ pf.A ,)t 

■ p I „1 . . 

Consider separately the innermost integral 

r — f .n f ~ f. dun 

“ i ^ I 'r _') (^'’ ~ T~—T" • 

J^in-l nJ- M«-i/ 1 — pn-l 

Writing X = (m„ — /in-i)/(l — gn-i) this becomes 

" f P(X)X*’(1 — gi^-i)*’ tfX =< ak(l -* 

*f0 

Hence 

( 16 ) Ml -*..,11 I p 

J“ J''»-a i<i< 1 ~ Pi-l \1 gi-l/ 
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The innermost integral this time is 


J' = t V — -A (1 - r^--- • 

\ 1 “ Mtt -2 / 1 “• Mn -2 

Write X = (^n-i — Mn- 2 )/(l — /in- 2 ); then (1 — m„_i) = (1 - X)(1 — and 
J' = f p(X)(l - X)'=(l - Mn_2)* dX = Ml - Mn- 2 )'. 

JQ 


Hence, finally, 


= Diitpi, / dfio'-’ dun-i n 

•'0 •' 1 ‘n-B i<n-l 


1- ~ A**-! \1 ■" Mi-: 


Mi ~ Mi -1 


(1 - M.- 2 )*. 


Observe now that the right member of (16) (except for the factor ft) may be 
obtained from (15) upon replacing n by n — 1. In other words Tlfi"’ = ftMi”“”. 
Since Aff’ = at, it follows that 

(17) = atft", n = 0, 1, 2, . • ■ . . 

Instead of calculating similarly the moments / gny„(/in) d/u„ of S„ it is more 

Jo 

convenient to calculate the quantities 


Nt' - f' (1 - da, 

*'0 


The momenta themselves may be obtained from the N’a by simple combinatorial 
formulas. 

It follows from (12) that 


(18) M"’ = f dao f dMi • ■ ■ f' dMn n r-^ V (1 - M,.)^ 

Jo JliQ •'Mn-1 tgn 1 Mi-l \1 — Mi-l/ 

The innermost integral m (18) is 

T// f (Mn Mn—1 I / * \fe d^Xn 

J"= pi -- 1 (1 - M - - , 

•'I'n-l \1 - Mn-l/ 1 - Mn-1 

Writing X = (gn - Mn-i)/(1 - Mn-Oi (1 - M-.) becomes (1 - X)(l - g„_i), so that 
J" = f p(X)(l - X)*(l - dX = ft(l - 

Jo 

Consequently 

= ft f dgo • ■ ■ f dg„_i n ^ P - M.-i)‘ 

(19) •'» •''‘"-a •<» 1 - M-l \1 - M.-l/ 
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80 that 

(20) .Vr* '= tir", « - n, 1. 2, 

The addilivity of the tii8t mnineuf yields an elieek no flT) and (20). 

Rinen A’(jS'„) &= ~ 2Z-,-^ tvvheu* A' denote >» or 

first mf)ment)i if slionld tie f)«(‘ lhat 1 -Yl" - 52.;^^ M{'. fn liTiiis of a's 
and (3’.s this mcaiiK 1 — /if " ui 52>:« di > *1‘'Y hi (iirii n-dne/','. to fhe trivial 

identity ai = 1 ~ 0i- 

Since 0 g 1 "'itli iiruluihilily 1 formeii ii, if is <■!»•,tr fhal the series 

converges with piohaldlily f to a .hiiiii .r, 0 y' t *" 1. Since A'fXj) - 
aid! and since /'j(x) ~ 22,,,n/-(cd. it h'limv.s that E(.r} n. oi/ti ai/ 

(1 — di) = 1. This implies (since 0 g j" 1) that .r iniKf Iw I'ljual to 1 with 
probaliility 1. In other words it is almost certain (hut> all the nold dust will 
eventually he difitribuled. 

3. Product representation, ('onsiderahle light is slicd on some of tlie iihove 
computations (and in fact the moment fornmlus (17» and (2t5) me jtroved luuw) 
by the following eonsitleratiuns. The principle of eiintlalde lieatment enun¬ 
ciated in the introductory iiaragraph wa.s hulrseiincnlly fomiidixisl by tlie condi¬ 
tional proljubility relation (ti). It. may also lie forinaliKeil by the following 
(equivalent) procedure, f/et i/o, >/i, 1/2, he a seijneiice of mili'jinulnU 
chance variables each of wluw* dietrilnitions w given by the prohahility density p; 
lot ?/nbc intoi'in’oted as the proiiortion, of tlx' arnonnt available to the /itli beggar, 
that he actually roccivoK. In other worda 

(21) = 2/„(l - Yh ic,), a « f), 1, 2, • • • , 

l<, rt 

The first main problem in this formulation is to ext're.ss the .r’a in terms of the 
i/'b. This IS most easily accomplished by an inductive i>roof of the formula 

(22) E -t, = 1 - II (1 ~ Vi). 

j 5 n ]<n 

For n = 0, (22) asserts merely that .To = i/o. The induedive step proceeds as 
follows: 

a:, = T„ + E = Ifnd - E * 1 ) + E a:, 

i^n—l I 

= 3/n n + II 

I S "—I i S n—1 

= 1 “ (1 - y«) n (I ~ 2 //) « 1 - II (1 " Vi). 

]&n-l j:^n 

From (22) it follows that 

(23) ain = y„ n (1 - y,) 

i<n 


E 



and 

(24) 
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= 1 - /S„ = 1 — = n (1 - 2/;)- 

J £ 71 / £ » 


The moment formulas (17) and (20) follow immediately from (23) and (24) 
respectiveljr 

Another very important application of (23) and (24) is the following theorem. 
If the first geometric moment (geometric mean) 


IS 


r = exp {^;(log [1 - y,\)] = expjjf log (1 - X)p(X) i 
different from zero ^i.e. if j log (1 — X)p(X) d\ is finite^ then the limits 


lim (x„/y„) '‘ and lim It]! 


l/n 


both exist and are both equal to r. 

Since according to (23) and (24), x^/yn = Jtn~i the two parts of the conclusion 
are seen to be equivalent. For the proof take the logarithm of both sides of (24) 
and divide by n, obtaining 

(26) logflii'" = j2/^„log(l -y,). 


Since, accoiding to the hypotheses .stated, the chance variables log (1 — y^) 
are independent and all have the same distribution with a finite expectation, 
the strong law of large numbers applies to the right side of (25) and (after 
taking exponentials) yields the desired concliasion. 

The result just obtained may be phrased as follows: with probability 1 
is asymptotically equal to r” 2 /„. This statement shows that in an obvious if 
somewhat crude sense the rate of convergence of ^3 is that (at least) of a 
geometric series with ratio r. This conclusion is further supported by the 
behavior of Rn , which again is the sort of thing one expects from a geometric 
series. (That is; the nth root of the nth remainder of a geometric series always 
does converge to the common ratio) As usual, more delicate quantitative 
results concerning the rate of convergence may be obtained by applying to 
(25) not merely the law of large numbers but the law of the iterated logarithm. 

The product representation of in formula (23) points the way to a generaliza¬ 
tion of this theory which may be of some interest. In this generalization Xn 
is still defined by (23) and the y’s are still independent, but the distribution of y, 
is given by a density p/, where the p’s need not be equal to each other. In 
terms of random alms this means that the condition of equitable treatment is 
replaced by the following weaker condition: the probability distribution of the 
amount that the jth beggar receives depends only on j and on the amount left 
by the preceding beggars, and in particular does not depend on the sizes of the 
alms already distributed. Many of the conclusions obtained under the simpler 
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hypotho-scK cany (ivcr to tlii.s with tally hliplit chaugcfi, In 

pavtionlar the diatrilmtioii fonunhis I?i, (8), and (121, and tie mMiieut ftinimliw 
(17) and (20). ate chaiiRcd only tn the extent of acquiriiiK «n extra wdiwiipt 
due to the differcuce of the p^. 


4. Applications. (A) The tiri(j;inal motivutioii of the jire,>«‘nt work wan an 
inve.'stigation of ttie notiriu of a random tnuaH di-strihutioii, and llu* remdta oh- 
tamed may he eonsideird jus one poadltle Hoiution of thi‘ prulilein of ilefining 
randomne.s.s for mass distnlmtions in tlu* special (discrete) ease where the entire 
mass is concentrated on the iion-iiegative inlegiTS. It wmihl he jif great inteix'St 
to extend the results of this note to vavioua coiUimums cawf. in which the srd, of 
integers is replaced by the unit interval, or the entire real line, or it diinensional 
Kudidcan space I iivtmid to study some of these extensions at another time; 
at the moment I merely mention one implieation of this .'•(alistieal point of vimv. 

Considering the se<iueiu'e {jTo , Jj, xa, ■ • ■ | sus a sy.stem of weights, the integer 
n carrying the weight j„ , varion.s (inestioius may he raisini eoneeruing properties 
of the discrete matis distriliutioim so (jhtainwl. For example: <lo the moments 
w* = exist and, if so, wliat are their averages and ihs|M*r.sion,H and, 

more generally, tlicir moments and their distrihutions? I shall .setth* here the 
(luestions concerning ex-isteiice and e.xpeelalion. 

The chance variable m* is non-negative and, even it if is inlinile with [Husitive 
probability, its expeetatnm is defined by /v'(m*) - a*A'(r„) - 

23 n 2 ;o = Xjn .-.o Hinee 0 < gi < 1, the last written series con¬ 

verges and therefore K(^th) is finite. This iinjilies that mi is linitr* with prob¬ 
ability 1. 

(B) It has been observed that the logarithms of the si'/s-s of particles sueh as 
mineral graiius arc froJinently normally distrihuled. Kolmogoroff^ has given 
an explanation of this phenomenon; the remilts of the pre.sent pajKW yield an 
alternative and in some respocUs simpler exiilanalioti. Bujipose* in hiet Unit the 
probability of a particle losing a chip the proportion of whoso siKt' to the size 


of the original particle is between X and \ + d\ i.s 7 ;(X) d\. With this .sloehasUc 
scheme the size of the remaining particle after n chips hax’o been hist is given by 
R„ . Since, by (25), log R„ is a .sum of independent chance variables with the 
same distributions, the Laplace-LiapounoiT theorem may he invoked to show 
that the distribution of li„ is for large n nearly normal, (It is necessary of course 


to assume here the finiteness of the .second geometric moment, or (Hpiivalently 
of the integral / log® (1 — \)p(X) dX.) The mean and the variance of each 

JO 


summand of log Rn are 


a = I log (1 ~ X)p(\) dK and 5® = j [log (I - X) - af p(X) dX, 


N. Kolmogoroff, "Ueber diva logariUimiach nurniiilc Voi'lcjluiigagcHpU dcr Dimon- 
Bionen derTeilchen bei Zeiatucckelung,” C, R. {Doklady) Acad. tiei. lULS'tf (N. 8.) Vol. 
31(1941), pp. 99-101. 
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respectively; consequently (by the additivity of the mean and the variance) 
the corresponding parameters of the distribution of log Rn (and hence of the 
approximating normal distribution) are given by (a + l)a and (n + 1)6^ re¬ 
spectively. 

(C) A special case of the distributions studied m this paper (namely the case 
of uniform distribution, p(X) = 1) arises in the theory of scattering of neutrons 
by protons of the same mass. According to Bethe\ "In each collision with a 
proton the neutron will lose energy. As long as the neutron is fast compared 
to the proton, the probability that the neutron energy lies between E and E + dE 
after the collision, is w{E) dE = dE/Ea, where Eo is the neutron energy before 
the collision. This means that any value of the final energy of the neutron, 
between 0 and the initial energy Eo, is equally probable." 

To calculate explicitly the distributions it is most convenient to start from 
(11). If p (with any argument) is replaced by 1 and the terms of the product 
are distributed, each under its own differential, (11) takes the form 


r‘ dun-l f 

dfi„-2 

. p dyo 

Jo 1 — Pfl -1 Jo 

1 ~ Mn-2 

Jo 1 — PO 


The value of the iterated integral is easy to obtain; v„{t) = (-l)"(l/nl) 
log" (1 — 0 - Since Vn{l) gives the distribution of the partial sum , the distri¬ 
bution of = 1 — ^Sn is given by a„(l — 0 = (" 1)”(1M') log" It is possible 
but not necessary to derive similarly the distribution of Xn. It is simpler to 
obtain this distribution by exploiting the symmetry of the uniform distribution. 
Since, according to (23) and (24), and Rn are both products of w -b 1 uniformly 
and independently distributed chance variables they have the same distribution, 
so that the density of the distribution of x„ is also given by (—l)"(l/n!) log" i, 
n = 0, 1, 2, ■ • . 

The roles of the geometric mean r (= 1/e in case p = 1) and of the normal 
distribution have also been observed in the physical situation. Fermi^ has 
expressed the geometric series like behavior of a:„ by the statement" • • ■ 
an impact of a neutron against a proton reduces, on the average, the neutron 
energy by a factor 1/e,” and Bethe* remarks that" ■ • ■ the actual values of log E 
after n collisions form very nearly a Gaussian distribution • ■" 


’ H. A, Betho, “Nuclear Physics, B Nuclear Dynamioa, Theoretical," lievtews of Modern 
Physics, Vol. 9(1937) p 120 

^This distribution has been calculated by 13 U Condon and G, Broit, “The energy 
distribution of neutrons slowed by clastic impacts," Physical Review, Vol 49(1930) pp. 
229-231. 

• Quoted by Condon and Breit, loc, cit. 

‘ Loo, cil. 



ON BIASES IN ESTIMATION DUE TO THE USE OP PRELIMINARY 
TESTS OF SIGNIFICANCE 

By T. a. lUNcKon- 
Iowa Siaic ('oUcge 

I, INTUOin'OTlOX 

In jmihloiua tif KUUiaticiil wi* nfitm tlu< juiitt frtH[UCtiey 

distributioii of Urn nainplo olwrvutioii.s jt|, /j, • * - .r-, in Iho form 

(1) /(Xi, > ■ • , x„; a,4.7. • ■ *U f/jT,, (f I, • ‘ , n) 

wherellic* funclioiuil form,/, i.s UMiumeil kiuiwn. mid a, drt. • ■ • an* (’iTtaiu iiiipu'' 
lalion paianieteiw wlu).sr vulue.s niav or may iml Ue known. (liven tiiiwapeeifiea' 
tion, Ktatintical theory iiruvidcH roiKint* nuiihr'inatinil unH'eKM". fur uhtainirig 
CKtimate.s of the i)ur!im(‘lei-,s «, 4 , 7, • • • rrom ihe ulisiTViitit 111.4 /i , /a, - • • j , 
In perforinmii; Lesth of aijinifieuuee wi> ufteu !ts, 4 Uiue that (lie dalu follow wnuc* 
dislnhutioii 

(2) /i(xi, ■ • • , x„ : H, 4, 7,'•‘)U dr,, (( “1,'‘'lU) 

where /i is a known fvmetiun or family of fimelionh. We may wjhU (o (eat (he 
hypothemH tlmt the diita follow the iiion* HiH'einliml diHlrilmtion 

(3) /ii(xi j * * * . Xh .0,4,7. *' * )U ifx,, (j 1, ' *' , 11 ) 

where fi is some, member or sub-urmiiJ of the fuuiily /i, (liven this siHieifiiiiititm, 
statistical theory provides routine matlieinatieul puwe.sHi's for li'stinjt such 
hypotho.ses. 

In the, application of statistical (lieory to specific data, fhere i.H ofton some 
nncc'vtainly alnmt the apiiropriate speeilieiitions in ('puafions (1), (2) and (3). 
In such eases proliniiniiry tests of siRnilieiinee have hrsui list'd, in practice, as 
an aid m ehoosing a siieeification. Wo shall give .several C'xainplrs fr(»rn the 
literature of statistical inetlKKlology. 

(1) In an analysis of variance, in order to obtain a liesl. estiuialt' of variance, 
we may be uncertain as to whether two mean siiuarea in the lines of the analysis 
may be assumed homogeneous, [1], Huppose that it is desired to esfiniatc the? 
variance o-?, of wliich aiMinbiiused oslimate «v is available. In tuldiUon, there 
is an unbiased estimate 4 of o-'a, where from the nature of the data it ia known 
that either al = tri or c\ < a\. As a criti'rion in making a deeisiou the following 
rule of procedure is used freciueiitly: Uist «V«a by the /<’-teHt, where h\ and Sa 
are the two mean stiuarcs. If F ia not .significant at aoiue assigned siguifleance 
level use (ius'{ -+ mi )/(m + Tia) m the estimaU! of ir\. If F is significant at the 
assigned significanec level, uso s! os the estimate of ef. 

(2) After working out the regression of y on a number of independent variates 
wo may be uncertain as to the appiopriatenesa of the retention of some one of 
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the independent variates, [ 2 ], To illustrate let us consider the choice between 
the regression equations y = biXi + and y' — b'lXi, after having fitted 
y = biXi + 1 ) 2 X 2 ; the population regression equation being y = fiiXi + fiiX 2 . 
In this case a procedure commonly used in deciding whether to retain X 2 is as 
follows; we test S 2 /S 3 by the F-test, where si is the reduction in sum of squares 
due to Xi after fitting Xi, and si is the residual mean square. If F is not signifi¬ 
cant at some assigned significance level we omit the term containing Xi and use 
hi as the estimate of fii. If T is significant we retain the term containing X 2 
and use hi as the estimate of /3i . A similar example occurs in fitting a poly¬ 
nomial, when there is uncertainty as to the appropriate degree for the poly¬ 
nomial [3], 

(3) In certain analyses we may be uncertain as to the appropriateness of the 
use of the x test. Bartlett gives an illustration in a discussion of binomial 
variation, [4]. He performs two supplementary tests of significance as an aid 
in deciding to abandon the mam use of the x‘ test altogether, and proceeds to use 
an analysis of variance instead It is of interest to note that the main use of the 
X test gives a significant difference at the 5% level while, in the analysis of 
variance, Fisher’s 2 is not significant at the 5% level Here again we might 
formulate a “rule of procedure” and follow through the analysis as in the pre¬ 
ceding cases. 

This use of tests of significance as an aid in determining an appropriate speci¬ 
fication, and hence the form that the completed analysis shall take, involves 
acting as if the null hypothesis is false m those cases in which it is refuted at some 
assigned significance level, and, on the other hand, acting as if the null hypothesis 
is true in those cases in which we fail to refute it at the assigned significance level. 
An investigation of the consequences of some of these uses is the purpose of this 
paper. 

It is proposed to consider the first two cases mentioned above: (1) a test of the 
homogeneity of variances, and ( 2 ) a test of a regression coefficient. A complete 
investigation of the consequences of the rules of procedure would be very exten¬ 
sive, since these consequences depend on the form of the subsequent statistical 
analysis. As a beginning, it is proposed to limit the study to the efficiency of 
these “rules of procedure” in the control of bias 

The need for solutions of a whole family of problems of this kind has been 
pointed out recently by Berkson [5]. 

II. EXAMPLE ONE: TEST OF HOMOGENEITY OF VARIANCES 

1. Statement of the problem, si and si are two independent estimates of 
variances o-l and xl respectively, (such that nisl/al , wl/a-l are distributed inde¬ 
pendently according to xi and xl, with ni and degrees of freedom). It is 
known that al < cl. To obtain from these an estimate of irl , to be used in the 
particular analysis in hand, we formulate a rule of procedure. 

2. Rule of procedure. Test si/si by the F-test. If F is non-sigmficant at 
some assigned significance level, we use (riiSi -f- n 2 sl)/{ni -f 71 /) as the estimate 
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of 0-1. If F is signiticant at winu‘ ii.swgHc«l signiticaiKN- levi-l hw- ,i? a« the 
('Htirnale of <A . Th(> G.stiniatf of oljtuiuctl l»y this rule of i»ri«‘c(lnn> \>iil lx* 
denoted by e*. 

3. Object of this investigation. If we follow .such a rule of procedure, what 
will be the bias in our estimate c* of af ? 


4. Derivation of the expected value of r*. 

+ JlnSaN 
+ fti )' 


V ni 


First we wi.sh to liiui 
if -i < A. 


fil 


where X is the value on the F-diatribution coriesiionding to wime a^sigiK'd sig¬ 
nificance level for rii and iia degrees of freedom. 

I^t «i = 6'i, Ha = Si . .Since Si and si are indeiKaideritly dwtribiited, (be joint 
di-stribution of Vi and Ui is 


cic}"'- 




exp 


2 


{nivi 


t 

<^1 


+ 



rivi dt>i , 


where ci is a constant and Wi and nj are the nNspective dcgn^t'cS of fns^dom. 
Ixit us make the transformation of variahle.s 


«i - fiiVi + nm , 


0 < Wt < X 


ut 


th 

e* 


0 ^ i/j ^ X ) 


«i 


then the expected value, Ex, of —• for it* < X is given liv 

Ml -f- 71* 


(mi + 7ia)Fi = 


Cl 


rr- 

Jo Jo (tl 


ul'”-* 


P(iii < X) Jo Jo (uiUt d- 7ij)'‘"*'‘"’’ 




exp 


"_1 
- 27 


Ml /mi Ml 
niUi + ni\ ffl 


H—I) dui dui 

(ra/_ 


■where P(m 2 < X) is the probability of Uz being less than X. 

Integrating out Mi and expressing the result in terms of the incomplete beta 
function we obtain 


(4) (iij -j. n^)Ei = f 

P(mi < X). 

where xo = (mi^X)/(71j tti^X), ^ = <7s/itj , 

We wish now to find the expected value of s? when sf/ss > X. Agiun wo start 
with the joint distribution of Ui and ej, given above and this time let 
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then the expected value, , of ui when 7 ^ - is 

X 


^2 “ 


Cl 


l/\ poo 




pl/A /»' 

1 \ io ii 


yiftj-lyUni+nj) 


1 fni , n2Y\ J 
exp —-j- dvidY. 

_ A \o-i ffa /- 


Integrating out Vi as a gamma function, and expressing the results as incomplete 
beta functions we obtain 


(5) 

where 


jp _ [I 

' P(F < l/X) 


Xa = nn5X/(n2 4- as before. 

6. Final Results. The probability that we use (riis? + n 2 sl)/{ni + nj) is 
P(itj < X), From equation (4) the contribution from this case to the mean 
value of e* is 


niZi/^rii 4- 1, \n^<r\ 4~ n.2Ja„(|ni, l-Wa 4- l)ir2 
4- Wii 

The probability that we use s? is P{Y < l/X). From equation (5) the contribu¬ 
tion from this case is 


[1 4^ 1) 2^2)](ri . 

The expected value of e* is obtained by combining the two cases, i.e., 

(6) E{e*) =[ 14 - Ihoihnr , 4- 1) ^ - Zx„(4ni 4- 1, 1 ^ 2 ))] a?. 

Hence the bias in e*, expressed as a fraction of a-l is 

(7) —— ["ZiofiTii, 2^12 4 - 1) ^ 4 - 1, iw2)1 

ni -h na L cn J 

We note that in estimating tri there will be a positive bias, no bias, or a negative 
bias according as 


4~ 1) 

ZxoQni 4- 1, ^rii) 


is greater than, equal to, or less than <nla \. 


6. Identity and checks. If (7i = (Tj , then in section 4, Ei = <rl and 

Pi'ih < X) = ZxjCini, In*). 
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l'’ron\ (4) this gives the. ulcutil.y 

{til + ) l>h) == + 1 , iih) -|- ihlxailih > 2"2 4 ' 0 

where xo = nil/iih + ni\). This identity may be established easily by ele¬ 
mentary calculus. 

The first result in equation (b) may be checked by noting that whim X ~ , 

i.e. when the two mean square.s are always ponied, .ro i.s 1 and eciuation (0) 
reduces to (rijcrl + + fh). Similarly wlwn X == 0, in which ease there 

is no pooling, .to = 0, and equation (6) reduces to x]. 

7. Discussion. In making a choice of an appropriate estimate of iri we may 
consider three procedures: 

(1) Use s5 always. This has the merit of having no bias, Init is likely to Iiavi' 
a large sampling error. 

2 » 2 

(2) Always pool, i.e., u,hc . When <rl 9 ^ o-j this is l)ia.sed, but 111 

Til -T tUl 

compensation will have loss sampling error Ilian (1) since it will be based on 
(wi + Tia) degrees of freedom, 

,2 

o. 

(3) Use the te.st of significance of 4 as a criterion in making (he decision 

S2 

as to whether to pool the two mean squares or not. If the li'sl di.seriininal.eK 
properly between case-s where, pooling should or Hhould not be. made, (be ])re- 
liminary test of signilicance. criterion will utilize the (‘xtra rh degree.s of frei’doiri 
whenever pormissiblo and also avoid the bia.s m method (2). 

In Table I the expected value E{c*) divided by a ], i.s given fur two seLs of 
values of Wi, TI 2 somewhat typical of thnsc frequently encmnileierl in iqijilii'd 
work, and for a series of valuo.s of xX/tn In addition to the case of always pool¬ 
ing (X = 00 ) and that of never pooling (X - 0), the re.siilts for X at the 1 percent, 
5 percent, 20 pereent levels and for X = 1 have been tabulated, Ity Kubtractiiig 
unity from the results the bia.s i,s obtained as a fraction of al . Tlu> Table was 
computed from the incomplete beta function Tables [d], 

"When the two mean squares arc always pooled, the fractional bias is negative 
and increases numerically as <rl becomes .small relative to o-?. By e.\'amination 
of the values in Table I for crl/crl = .1, it will lie seen that the preliminary test 
of significance controls the, bias well when (r\ is much amallev than ori, tluit is 
when a large liias from pooling is most to be. feared, This result happens be¬ 
cause in such cases the preliminary test allows pooling only in a Hiiiall jirupor- 
tion of samples. 

If X is taken at the 1 or 5 percent levels, the maximum bias aiipeam to occur 
when a\/(j\ is in the region 0.4-0.5, there being little bias when crl is near cx{. 
The lower values of X (20 percent or X equals 1) control the bitus .satisfactorily 
m the region irl < .Qal , but have a fairly substantial positive bia.s when ff| = CTl , 
that is when pooling would actually be justified, By use of tlic relation between 
the incomplete beta function and the sum of the terms of a binomial series it 
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can be shown that there is always a positive bias when a-l = al and that for 
given numbers of degrees of freedom this bias is greatest when X = 1. 

To summarize from the example in Tabic I, it seems that for small values of 
Til and rii none of the values of X which have been investigated controls the bias 
throughout the whole range 0 < <r\l<n < 1- 

TABLE I 

Expected Value oj E{c*)/a\ 

Case 1. Til = d, rii, = 20 


o-j/o-J 





.1 

.2 

.3 

.4 

.5 

.0 

.7 

.8 

.9 

1.0 

X 

— 

00 

.250, 

.333 

.417 

.500 

.583 

.667 

.750 

833 

.917 

1.00 

X.oi 

= 

4.43 

965 

.870 

.791 

.750 

.748 

.775 

.821 

.880 

.948 

1.02 

X 06 

= 

2.87 

.991 

.960 

.924 

.901 

.892 

.903 

.930 

.970 

1.02 

1.08 

X 20 

= 

0.00 

1 00 

.999 

1.00 

1.01 

1.02 

1.04 

1.07 

l.ll 

1 15 

1.20 

X 


1 

1.00 

1.00 

1.01 

1.03 

1.05 

1.08 

1.11 

1.15 

1.20 

1 25 

X 

=s 

0 

1.00 

1.00 

1.00 

1.00 

i.OO 

1 00 

1.00 

i.OO 

1.00 

1.00 


Case 2: ni = 12, «2 = 10 





.1 

.2 

.3 

.4 

.5 

.6 

.7 

.8 

.0 

1.0 

X =00 

.591 

.636 

.682 

.727 

.773 

.818 

.864 

.909 

.955 

1.00 

X.oi = 4.71 

.981 

.896 


.814 

.824 


.884 

.922 

.963 

1.00 

X 08 = 2.91 

.998 

.973 




Mia 

.928 

.955 

.989 

1.03 



.998 


.987 

986 

.991 


1.02 

wa 

1.07 

X = 1 



Q^l 




1.04 

1.06 


1.11 









1.00 


1.00 


8. The variance of e'*’. Using the same method wo may obtain the variance 
of G*. The final result is 

n\{ni + + 2, + 2711 712 ^* 0 (|?ii L H" l)o'icr2 

_ + 712(712 -f~ 2)7j,(^?ii) ^rij -f- 2 ) 0-2 

{m + rwf 

H-hlL— [1 — 7*o(j7li + 2, 57l2)]o-i — Tl H-^- 

Til L ^1 + 

+ 1) -5 ~ d’i„(^ 7 li 4 - 1, 2W2)|J <ri. 


( 8 ) 
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From the relations lu doriviriK fliis rc.snlfc the followirifi; idontily was oldaiiied: 
(ni 4- + 2)(7 (,i -h n2)/i,(ini, ln-<) = ntOh + + 2, 

+ 2niihl + 1 , + U H' >hOh + 2j/i„(j!'ii 1 l>h + 2). 

This identity can he readily ('stahlished l>y elementary caletUtus. 

As a check on the result in cciualion (S), we note that if X — '-n, flien .rn -• 1, 
si 

and -j < X always, 'fhe variance of the e.stiinate of variance Itee.onies 
Ss 

2(7ii<Ti + nicri)/{ni + 7iif, which elnvdc.s with the variance of (uixl d- rtusl)/ 
(ni + na) for the case of always nouHnp;. If in addition tr’i -- tri, then 
V = 2(rl/(ni + ni)- If X = 0, then j-o — 0, and 4/.S-2 S X alway.s The varianee. 
of the estimate of variance heeoine.s 2a\/nv which eheek.s with the variance of s? 
for the case of never poolinp;. 

The expression for the varianee of r* (‘tiahles ns to inve.stiKnle how inneh has 
been gained m terms of reduction in vaiiauce l>y the use of tlu; preliminary test. 
The quantity [V + (Bias)') is the appropriate value fur the whule samplmg 
error, whore V is given by (8) and tlie bias by (7). For the two numerical 
examples these quanlitie.s are .shown as fraetioim of o-l in Taltle H. 

As a standard of eoinparison the. variances of tlie estimate si (no pooling) will 
1)6 used. In those examples the preliminary test with X - 1 prudiu’es a varianee 
smaller than that of «! fur all values of cl/ol except the lowest (0.1) wliere the 
two variances are equal, A.s \ is taken siieecHsively iiigher th(*ri' is a suhstanlrial 
reduction in variance when e-j is ncuir o-* lint, an increase m variamu' over tluit of 
Si when cr\/a\ is small. Throughout nearly all the range of values of (r’/fri, 
the smallest variance is obtained by always pooling (X - <»), despiU; the rela¬ 
tively large bias given liy that method. This result is a reflection of the in¬ 
stability of estimates of variance which arc based on only a few di'grccs of 
freedom. 

III. EXAMPLE TWO- TEST OF A REGllEBSION GOEFFIOIENT 
1. Regression and some properties of orthogonal functions, lyct 
y = PiXi + PiZt -f c 

be a linear regression of y on the two variates xi and Xi in whicli Pi and are the 
respective population regression coefficients and c is the error. We assume, that 
xi , xi and y arc measured from their respective sample moans and that tlie values 
of ail and x% are fixed from sample, to sample. In order to make comparisons 
among samples of different sizes we assume that xi and Xn have unit variances 
and correlation coefficient’ p so that 

S{x\) = n ~ 1, Sixl) = n~ 1, SiziX^) = pin ~ 1), 


‘ Although p is commonly used to denote a population correlation coofTicient, we are 
using it hero for the sample correlation coefficient between the fixed variates as, and Sj . 
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TABLE II 

The Variance of e’*' Ahoul its True. Mean- 


y + {Biasf 

4 


Case 1. Ml = 4, Mj = 20 


<r*/a! 



.1 

.2 

.3 

.4 

.5 

.6 

.7 

.8 

.9 

1 0 

X = 

.577 

li 


.275 


.149 

.111 


.076 

,084 

X.oi = 4.43 


»wi! 




.323 

.243 

.184 

Willi 

.137 

X ,05 2,87 

.514 

.545 

.554 

.528 

.479 

.414 

353 

.299 


.237 

X,20 = 0 00 



.493 


.458 

.435 

■s 

.374 


.360 

X = 1 

.499 

.493 



.441 

.423 

■Ql 

.389 

.381 

.387 

o 

il 



■ 

Bi 




500 


.500 


Case 2:ni = 12, ns = 10 





,1 

,3 

.3 

.4 

.5 

6 

.7 

.8 

.9 

1.0 

• 

\ = CO 


.183 

154 


.112 


m 

|1 


.091 

X.oi = 4.71 

.185 

.218 


.171 

.141 

.118 

■s 


.092 


X 06 = 2 91 

.170 

.187 

.194 

.183 

.163 

.142 

.125 

.114 


.109 


.167 

.169 

.171 


164 

.156 

.146 

.139 


.135 

X = 1 

.167 

. 166 

165 

.162 

.158 


148 

.144 

.144 

.147 


.167 

,167 

.167 

.167 

.167 

.107 

.167 

,167 

.167 

.167 


where S(xi) denotes summation of Xi over the sample, with similar meanings 
for S(xi) and S(xiX 2 ), where n is the sample size, 

We make the orthogonal transformations 

|l = ail , ^2 = X 2 — px\, 

then 


y — + pfi) + c. 


But 


Si = n- 1, 8^1 = (.n- 1)(1 - Sm = 0, 


therefore 


Siy^s) = 0 i(n — 1) + /? 2 p(n - 1) + S(xie), 


and 

Siy^i) = Biin — 1)(1 — p^) -f- S{x 2 - pxi)e. 
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Now if we represent tlie vt'Ki'essiun eix'flieieuts nf 1 / nn llie ns /<'s wo have 

BvSifV - /^2.S'(is) = «fej/K 

The reduction in the, total hiini of winareK due (0 ,ri iKnoriii)? x-j i.s 

„ t«(5i?/)r' \(n - l)(d, d- dsp) 4- W.r,e))> 

B.S(rt,) - _ I 


The reduction in the tot til .sum of squun'a due to .rj after lit firm xt i^^ 






(fjt — l)ds(l " P®) 1- B(xt ■- fixO/f 
(a - l)(l - p=) 


The reduction in the total suiu of .scpuire.s due tti rt'KreRsion is 

[(n — l)()9i + ftp) -f- iS'firie)]' (»SV’(r* — pXi) + — I)ft(l ~ p*)]* 

^ a'- 1 ■ (a - 1)(1 - pd 

in which the. two parts are independeutly di.strilait<’tl, 

Let hi ho tlio regre.^sion eoeffieient of 1 / on x, w!u*n the term eonlaining xi is 
omitted from the regression e(|uiilion. Now, 

,/ „ (n ~ 1)(di *1* ftp) + M(.rie) 

“ «(t!) * » - 1 ■ . 

Hence 

(9) Kiln) = + ftp. 

Let ft be the rpgrcs.sion eoetricient of y on a** if both Ji ami Xt are vmed. Then 

7 _ R _ 

ft - Ih ~ - (n - 1)(1 - p’) 

And 

V(h) = ^ 

UsMf 5(il) (~a- 1)(1 -p^)’ 


The normal equations for Y = biXi + ftzi arc 



biSix]) + ft^XaiiXj) = Six^y), 
hiSixiXi) + hSCxI) - KiXiv). 

Now 


Therefore 

S(xl) 


= ft + ftp, 

or 

ft — hi — ftp. 
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(10) E{bi) = /3i + fiip — pE{ii). 

Wc notice that if p = 0, hi is unbiased in any selected portion of the population 

2. Statement of the problem. To obtain an estimate of hi, in a particulai 
analysis in hand, in -which it is desirable to choose by means of a test of signi¬ 
ficance between using the regression equation Y = bi%i -f- b 2 X 2 and Y' — l/i-ri, 
we formulate a rule of procedure. 


3. Rule of procedure. Calculate the following analysis of variance: 

Degrees of freedom Sum of squares Mean s([uare 

[{n — l)(di + ftp) + '^(rcie)]^ 


Reduction due to a:i 

Reduction due to xi 
after fitting xi 

Residual 


n — 1 

[{n - l)ft(l - p^) + S{X 2 - pXi)eT 
(n - 1)(1 - p^) 

S(y - Yf 


2 

Si 


S2 


S3 


2 

Test "j by the F-test If F is non-significant at some assigned significance 

S 3 

level we omit the term containing xj and use 

_ (n- ~ l)(ft -h ftp) -h S{xie) 

n — 1 

as the estimate of /3i If E is significant, we retain the term containing xa, 
and use hi as the estimate of /3i ■ The estimate obtained by this rule will be 
called h*. 


4. Object of this investigation. If we follow such a lule of proceduie, what 
will be the bias in h* as an estimate of ffi ? 


6 . Mathematical derivation of the bias. First, we wish E{h'i) when 

s| ^ , bl ^ \ 

si si {I - P^Kn- 1)’ 

where X is the value on Snedecor’s F-distribution corresponding to some assigned 
significance level for 1 and (n — 3) degrees of freedom. From (9) wc have 

(11) E{bi) = ft -f- ftp, 

2 2 

no matter what the value of , since from section 1, Si and S 2 are independently 

Sa 

distributed. 



2(K) 
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Xc'xt WO wusli"'Ill'lliS X or I ^ - ,, 

.-ij Hi (.1 “ P-Ku - 1} 

fiiul il moro oouvoiuoriL to litid first /^(/h) wlion 

fjj ^ . Vi 1 

,s;- “ (1 - - 1)' "* hi ~ xi’ss 


. To ()i)t;un this W(‘ 


,, ^ si luul o,, ■ 

The joint dustrilmtion of /o, cj i.>> 

wlicre K is a ooristuut Wo nmkc the Iraiisformation of variahlof, 

w — r2» “ 1*2 (iu\ 

0‘i 

tlxon the joint cHytriluitiou of />i and u is 

Zve >'•* ”1'!“ hi du dl >,. 

Taking the expoctoU vaku* whon i< < . wo havo 

Afyi 


O ilmen 


exp 


ih - th? (m - HI 


- 6s u J du dih , 


where Oj = ss, and P\^u < j^^-J is the probability that u Ih* Ic'hs than or (>(|ual 
1 

to —. 

AC 22 

Dropping subscripts for com-enicuco and expanding the factor which involves 
e to the first power of b, we have 


E(b) = - 
P 


where 


-fiVic r^l>,c 




n-J ,,i(rl-S) 




du db, 


— 0<u<:~. 

AC 
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Now, clearly the even tci’ins of the series vanish whethei ti is odd or even when 
b is integrated out. 

After integration with respect to b, we have an infinite series in which the 
typical term (apart from constants) is of the form 

+ {n - 3)cu]‘‘’’+^’ 


where r is an even positive integer. Subsequent integration with respect to u 
leads to an infinite aeries of incomplete integrals of the F distribution. By 
transforming the integrals, the senes may be expressed in terms of incomplete 
beta functions as follows: 


E(h) = 






(“ ^ xs) 

21 W/ "“V 2 ’2/ 


Let 


+ 


n = A nv . = (1 - P )(^ - m 

2cm 2 ' 


+ 


Then we have 



and X is the desired % point of the F-distribution for 1 and (n — 3) degrees of 
freedom Now fiom (10) we have 


E(bi) — /3i + P 2 P — pE{b2) 
which enables us to obtain 7? (hi) from (12). 


6 . Final result. From (10), (11) and (12) we have 

E(b*) = < x) (/3i + /3^p) 4- [1 - < x)][^i + p{p2 - Eib2)\] 

1 - < X 

\V3 


= /3i + pPi 
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The bias in h* is 




P 




(fh) 


Bubalitutin}!; the value of we obtain 

Bias = p0i 
i 


where .ro = 


"b 1 


Ml 


71—3 

7. Checks, From section 5 wo have 

m^) = 


p 


, jLmt '‘»n 

% ~ 


I, 2 ’ 2 


whore so 


1 

+ 1 


n — 3 

If X = 0, thou So = 1, and E{lh) = 0t . 
Also from section fi we have 


Ti' ^ fi V r '■* m Y 

Bias = pfi 2 ^ 2^ ^-j- I ■ 2 ’ 2 ’ 


If X = 0, then So = 1, and Bias = 0. 

If X = «>, then So = 0, and Bias = pft . 


8 , Discussion. From the mathematical form of the, Ijiaa, 

Bias = Pds [l - g “ ® - /xo 2 ’ I ’ 


where Xo = 


+ 1 


four deductions follow immediately: (i) There is no bias in estiinatinK 0 i , if 
p or /Jo is zero, (li) The, cocflicient of fUt iu the formula is less than or at most 
equal to one in absolute value, (iii) The sign of the bios depends upon the signs 
of p and ^ 2 ; it is positive if both are positive or both negative, it is negative if p 
and Pi have opposite signs, (iv) The bias is estimating Pi is mdoiiondent of Pi. 

We shall discuss the bias in a few special eases by means of Holectcd values of 
n, p, Pi and X In Table III arc exhibited the values of the bios for n equal 
to 5, 11, 21, each at p equal to .2, .4, .G, .8, and Pi equal to .1, .4, 1.0, 2,0, 
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and 4 0 These values have been computed at the 5% point for X, and at X = 1. 
These special cases seem to indicate: (i) If we fix p, jQa , and X and increase n, 
then the bias decreases, (li) If we fix p, 02 , and n and change X from the 5% 
point to X = 1, the bias decrease.s considerably, (iii) If we fix p, ?i, X and increase 


TABLE III 
The Bias m EsLimating 0 i 




X ofi “ 
?! = 

18 513 
= 5 



X 05 = 
n = 

5.318 

11 



X 06 » 
n = 

4.414 

21 


p 

.2 

4 

G 

s 

.2 

4 

G 

.8 

2 

4 

6 

8 

0.1 

017 

034 

051 

.069 

.015 

.030 

.046 

061 

014 

.020 

.044 

.059 

0.4 

.067 

134 

.202 

272 

.049 

.101 

159 

.227 

.033 

.071 

122 

. J 93 

1 0 

142 

.292 

.455 

.640 

028 

.072 

.164 

350 

001 

006 

025 

.132 

2 0 

162 

358 

027 

1.038 

.000 

000 

.001 

.083 

.000 

.000 

.000 

.001 

4 0 

.035 

.101 

.282 

898 

.000 

000 

.000 

000 

.000 

.000 

.000 

.000 



^ = 

= 1 



X = 

1 



X = 1 




n = 

= 5 



71 — 

11 



n = 

21 



.2 

.4 

.6 

8 

2 

.4 

6 

8 

.2 

.4 

6 

.8 

0.1 


iS 

on 

H 

.004 


.011 




m 

OQ 




1 

la 


019 

.032 

IQ 1 

1^ 

Ql 

m 


1.0 



IQ 1 

095 



.010 

IQI 

1^ 

IQu 

KM 


mSm 



: 

mm 




IQ! 

1^ 




m 



n 

H 





Q 





02 the bias increases and then decreases. This may be explained in the following 
manner. From section G, the bias may be written in the form 


Bias = P 02 


+ i]. 


^^)v-r (n -3 

Now if p, n, X are held constant and 02 is relatively small, P[— < X ) i 

Vs / 

large and ^ 2 ’ I relatively large 

tively small. Hence, for a while as we increase 02 the bias will increase, but as ft 

gets larger p(— < X) and ^ ae~'‘Ix„\ „ -, ^ becomes smaller while 

Va / ’—0 \ " ■" / 

P^ > X^ becomes larger. Hence, a value of ft will be reached at which the 


is relatively 
is rela- 
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bills begins to dofri'iisi'. (iv) Jf w (ix n, d;, iunl \ :ui(l inciViiM' p, flu* bias in¬ 
creases without t'xcc'ption 

The above results vi're obtuineil under Ihe lushuiuplion {bat a test ot signi¬ 
ficance criteiiou is used in making ii cluiici' as to (he uiuuber of indejieudenl, 
varialilos to be retained iil'ler llu' regii'ssion ij - 1 /s,’: has been fitted. 

Tf this test of .significance criterion is uw'd, we may wish to have a means of 
controlling the bia.s l'’iom a .study of 'lalile III wi‘ note that the bnw may !»' 
decreased by increasing n and by using X - 1. We also notice that as /ts in¬ 
crease,s from D.l to 4.1) the biu.s inerease.s and tlieii d(‘crea.M's; and .so inwse.s 
through a maximum value, Ilenet', if we hav(> a regression in which dj is fairly 
well below or above this maximum value, we would ex[M‘et a smaller bias. 

The bias 111 estimating fti is ‘'uuHtudentmal,” i.e., is a function of the jiopiilation 
parameters p and ft. In any iiartieular luialy.sis in liaiid, it would be ncceasary 
to know the value.s of p and ft or he willing to use estimates of them obtained 
from the data 

It is realized that only a beginning luw been imwle on th(' regression problem: 
an investigation should Ik? undertaken of the more geneuil problem of the use of a 
test of significance criterion m making a choice as to the munln'r of indeiHuident 
variables to lie retained after the reguission 

V = 1)1*1 + 1)5*3 + ' ■ ■ + 

has been fitted. 
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THE PROBABILITY OF CONVERGENCE OF AN ITERATIVE PROCESS 

OF INVERTING A MATRIX 


By Joseph Uli.man 
Columbia University 

Introduction. The inversion of a matrix is a computational problem of wide 
application. This is a further study of an efficient iterative method of matrix 
inversion described by Harold Hotelling [1], with an examination of the prob¬ 
ability of convergence in relation to the accuracy of the initial approximation. 
The lines of investigation were suggested both by his article and by helpful 
comments made during the course of the reseaich 
The inverse of a matrix can be obtained to anv desired degree of accuracy by 
using a variation of the Doolittle method, and starting with a sufficient number 
of accurate decimal places in the matrix being inverted. This procedure be¬ 
comes inefficient if the order of the matrix is large, or if the desired degree of 
accuracy is very great In either case the efficiency can be greatly increased 
by first obtaining an approximation to a small number of decimal places and then 
applying a method of iteration until the dcsiicd accuracy is achieved. 

1. Iterative methods. Hotelling’s method of iteration is as follows Let A 
be the matrix to be inverted and let (7o be the approximation to the inverse. 
Calculate in turn Ci, Ci, • • • where, 

(1.1) = C42 - AC„). 

This sequence of matrices will converge to the inverse of .4 if the roots of 

(1.2) D = 1 - ACo, 

are all less than umty m absolute value 
The iterative method (1.1) will be generalized to yield a class of iterative 
methods, one element of which will be shown to be moie efficient, in certain cases, 
than method (1.1) The generalized iterative method is, 

(1.3) = C„{1 + (I - ACJ + (1 - ACJ' + ■ • -f (1 - AC,,f-^\, 

For every k, the condition for convergence is that the roots of the matrix (1.2) 
all be less than unity in absolute value. 

A method of comparing the efficiency of these different iterative methods 
aiises from the following considerations. Since 

(1.4) Co = A-\ACo), 
which is equivalent to 

(1.5) Co = A-'(l - D), 
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it follows that 

( 1 . 6 ) = ^(1 - or. 

When the roots of 1) ate all l(\ss than unity in ahijolule value, (1.0) has the 
infinite e-vpansion, 

(1.7) -1 '-Cod + I) + I)' + })■' + 

Tlic general itenitive iirocess (1.3) gerutnites the infinite eeiie.s in the following 
manner, 

(1.8) (1 + 7) + /)' H- • ■ ■ + 7->‘ ‘)(l + 7)‘ -1.h ") 

■(! + //'+ ■+'’)■•• . 

Each parentheses corresponds to one iteration. lienee k" temis are gt'iierated 
by m iterations. In order to achieve the tuaturae.y of n tt'rni.s in (1.7), rn 
log« n/log, k iterations arc reepured. Kiieh iteration involve.s k matiix luulti- 
phcationa, so that km - k logr n/logr k Is tlie total uuniher of matrix inullipliea- 
tions necesstiry to achievi' this degree of acciiraey. 

The integer for which this is tr niininmin is three. 'I'lua'tdort* the “mo.st efli- 
cient” method of iteraium is, 

(110) = rJAi + a - .-tf.'j + (1 -• .If'.)'!. 

If the desired degree of accuracy can he aehioved hj one application of (1.1). 
or by two applications of (l.l) hut not hy one application of (1.10), then (1.1) 
is preferable. 

2. The condition for convergence. The heipionce, 

( 2 . 1 ) a,, (!,, (h. ••• 

obtained from (1.3) will converge to the inverse of .1 if the roots of 

(2.2) 77 = 1 - AC'o, 

are all less than unity in absolute value Tlie following lussuiuptiun.s clcterniinc 
the nature ot D. 

We assume that the expected value of eacii element of tlu’ first approximation 
Cn IS equal t.o the corresponding clement of the exacib inverse, of A, The actual 
values of the eloment.s of Cn will deviate from their expected values. We will 
consider two important cases. If the deviations are entirely due to the fact, that 
the elements of C\ arc only accurale to a limitcil numlx'r of (kiciimd jilaces, say 
k, then the deviations may be regarded as distributed with constant diuisity over 
a range of length 10“\ It will be ai3.sumed that, the deviations of llie elements 
of Co from their expected values are independent, While tliis ca,s(' arises in 
practice, we will first treat a closely related case, which lends itself to exact 
treatment more readily We assume that the dcviation-s of the element,s of Co 




C.'ONVEUGENCE OP AW ITERATIVE PROCESS 


207 


are normally distiibutcd about their expected values, with variance y = 10“^^/12. 
The variance /r is the same as that which arises if the probability density is uni¬ 
form with range 10“*, 

The elements of E, the matrix of deviations, 

(2.3) E = - Co . ■ 

are mdependontly and normally distributed Combining (2.2) and (2.3) we 
obtain 

(2.4) £» = 1 - ACa = - Co) = AE. 

Let p be tlie order of the matrix A. Each element of D will be a linear com¬ 
bination of p independently and normally distributed variables, and therefore 
will itself be normally distributed. A sufficient condition for all the roots of D 
to be less than unity in absolute value, and hence for the process of iteiation to 
converge, is for the sum of the squares of the elements of D to be less than unity 
in absolute value We will use the following notation 

(2.5) dij : the element of D in the tth row and jth column, 

iV5, = Z E (&, 

A procoduie suggested by this relationship is to deteimine the piobability 
distiibution of iVL , so that probability statements concerning the absolute value 
of the roots of D can be made. Because the elements of D are not all inde¬ 
pendent, no multiple of N]} can be expected to have the distribution 
The distriliution of N]} is shown to be closely related to the chi-square distribu¬ 
tion in the next section, and on the basis of this relationship, lower bounds to 
the probability of convergence of the iterative process are developed in section 4. 
In section 5 the exact distribution of the norm is obtained for a general class of 
cases The final section is concerned with the validity of applymg the results 
of this study to a practical situation, where the deviations of the elements of Co 
from theii expected values are uniformly, rather than normally, distKbiited. 

3. An equivalance. Let e,j be the element of E m the itli low and the jth 
column, and be the element of A in the ith row and the jth. column. From 
(2.4) and (2 5), we find that 

di; y .) O/ik^tS] • 

K 

Since the elements of E are independently and normally distributed with 
vaiiance y = i0~“/12 it follows readily that 

(3.2) E\€\jCkh\ ~ 5,A:5j7i/l 

1 The number in tlie parentheses will indicate the number of degrees of freedom of the 
chi-square distribution. 



m 


.lOhl.l’II l’IXMA>; 


Making use of (3.11 and (3.2), we iind that for two (U, in the same cohinm, 
(3.3) ^ 1 (iitOkt t 


■while for any tivo cL, ni diffprent. eolninns, 


(3.4) 


/^[d,//*),] = 0. 


From (3.3) and (3.4) it follow.H that it i.s fienniasiblc to regard tlu' eleiiK'Ut.s of 
the p columiw of 1) as tlie laiordinafeH of p nulejirndently .selected points from a 
multivariate normal universe with covarianei' matrix a ■— nAA'. W(' will let 
X = 

The raonient generating function of the sum of .siiuares of tlie coordinates of 
any point is 


(3.5) 


|x!' 

X - 2t|‘‘ 


This can also be written as 


(1 - 2<n i)‘(l - 2«r, t)‘ • • •' (1 " 0‘ ’ 

where a-i, • • , aic the eharaeteristie roots of cr. 

Since N]) is the sum of p independent expressions of this type*, its moment 
generating function is the pth power of (3.6), 

(]"- ••• (] - 

This expression is the moment generating function of 

(3.8) <nX(p)i + <r 2 X(p)i + • • • + ffpXlplp ) 

where the X(p)i are all independent. 

Writing the roots as 


(3.9) CO, an — ki, • • • , ffo — kp^\, 

where ao is the largest root of a, and all k, > 0, it follows that N^n has the same 
distribution as 


(3-10) <ro ^ xL)i — £ ^/X(ph • 

I fm\ 

Therefore, making use of the reproductive power of x*i we obtain 
P{No < 1) = P ((To 2 X(p)t < 1 4- ^ kX(p); 


(3.11) 


- P |<roX<pp < 1 + £ ^jXWjI ■ 



CONVERGENCE OF AN ITERATIVE PROCESS 


209 


By making special assumptions about the kx, close approximations to the 
probability that No will be less than one, and hence that the process of iteration 
will converge, can be obtained Instead of following this procedure, it is more 
desirable to have definite lower bounds for the probability that will be less 
than one This will lead to an overstatement in the number of decimal places 
of accuracy necessary m the lirst approximation Co to assuie convergence, but 
it will practically eliminate the possibility of having to recalculate the first 
approximation, and hence will lead to greater efficiency in the long run 


4. The derivation of the formula for determining the required degree of ac¬ 
curacy. The inequality used in this section is derived in two steps from (3 10). 
Since fc* > 0 (i = 1, • • , p — 1) it follows immediately that 

(4.1) PlAn < 1) > P{<Toklv < 11. 

In order to use this inequality, the upper bound for ao 

(4.2) < (tr * 
can be used. For t = 1, 

(4 3) (7o < tr <r = tr fj.AA' = n tr AA' = hN\ . 

Di. Wald pointed out that using (4 2) for t = 1 reduces the amount of informa¬ 
tion retained in (4.1) to that which is contained in the inequality, 

(4.4) NiD) < N{A)NiE). 

A closer upper bound is feasible in any particular case, and can be introduced 
at this point by letting f = 2 oi 1 = 3. The following formula will be developed 
for the general case, making use of (4.3). 

Substituting (4 3) in (4.1), we obtain 

(4 5) < 1} > p|xU < 

It is desirable to separate the effects of the order of the matrix A on con¬ 
vergence, and the order of magnitudfe of the elements Hence ive introduce as a 
measure of the average size of the ai, their root mean square m, so that 

(4.6) in = a\J'p 

' > 

Hence 

(4.7) iVx = pw. 


The final form of the inequality is 


P[Ao < 1} < P 



12 - 10 ^*=\ 


(4.8) 
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First we will obtaiu lui e^iiressitm for the numlicr of (Icciiiml pkico.s nHiuired 
ill the first approximation to make the prohahility of eoiir-ergeiiee at least .1)99. 
Then the expression will ho ehoekeil directlv hy means of fil.S) and tahk's of thi' 
chi-square function. 

For large values of 71,' \/2x'(pS) approximately luirinally di.stril mUal with 
mean value ~ 1 and unit varianeo [2], [5], Applying this transformation 
to the right hand side of (t.H), and noting that 3.1 standard deviations is slightly 
greater than the deviation corresponding to .999, we obtain a.s tin* condition for 


(4.9) 


or 


(4.10) 


that it is sufficient that 


(4.11) 

/“if - Vr/-£ > .11. 

This is equivalent to 


k > logio p + logio m + logiof V??* - 1 + '^/i 
(4.12) \ V 2 


- ^logio 2-1 + logio V 2 '. 


Since the characteristic of a logarithm i.s inseii.sitii’c to the argument, rounding 
oS will introduce a negligible error, and wc finally obtain an upjK'r hniit to the 
lower hound of k, 


(4.13) k > logio m -b logio f + logio iv + 3) ~ .55. 

In order to verify the accuracy of (4.13) for small values of p, certain values of 
p, k and m are chosen and the probabilities associated with (-1.8) determined [2] 
The entries m brackets arc the corresponding values of k determined from (4.13). 

A typical example will illustrate the u.sp of talile on facing page. Let. the matrix 
A to bo inverted be a fourth order correlation matrix. TJie mean magnitude m is 
about I and p = 4. If the first approximation Cn is obtained to one place, accuracy, 
then the probability that the Heiiucnce (\ , f.'a, • • ■ will converge to rf' will bo 
greater than .999. Using formula (4.13), we obtain k = .53, Since one is the 
first integer greater than .53, the table verifies the use of the formula. 

Although the formula was developed on the assumption that p is large, every 
value calculated is consistent wdth the tabic. This lends support to its use for 
small values of p. 
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The Prohabihly of Convergence of Ihe iLerahvc Proccsh* 



\ P 
/c\ 

2 

3 

4 

5 


-1 

0 + 

0+ 

0+ 

0-|- 

m = 2 

0 

[.05]. 982 

[.33] 199 

[.53]0+ 

[ 70]0+ 

1 

1 

1- 

1- 

1- 

1- 

1 


-1 

0+ 

0+ 

0+ 

0+ 

m = 2 

0 

[.85]. 051 

[ 93]0+ 

0+ 

0+ 


1 

1- 

1- 

[1.13]. 715 

[1.30]0- 


2 

1- 

1- 

1- 

1- 


0 

0+ 

0+ 

0+ 

0+ 

m = 10 

1 

[1.35] 439 

[1.63]0+ 

1[ 83]0+ 

0+ 


2 

1- 

1- 

1- 

[2.00]1- 


* “1 — ” means greater than ,999. 


It has already been pointed out that h is not sensitive to rounding off of the 
argument of the logarithm. Thus for p = 20 and m = 2, we can let logio m = 3, 
logio p = 1 3, logio (p + 3) = 1.36 and obtain 

/c = .3 + 1.3 + 1 36 - .65 = 2.41, 

from which it follows that three decimal place accuracy in On will piactically 
insure convergence of the iterative process. 

6 . The mean, variance, and exact distribution. To obtain the moments of 
N]} , the most convenient form to use is (3.8). Since the x}p)i are independent 

(5 1) EiNl] = S[E = p E V.. 

% 1 

invi = - {E[Nl]f 

= £ TE + 2 E x\phx\p)ii^v<y?\ - (p E 
= (2p + p“) E o"! + 2p“ E — P^ E di “ 2p^ E o'lO'j 

I i i<! 

= 2p E 

i 

These can be expressed in terms of the elements of A and the variance of the 
elements of E, since 

E O'; = tr (ff) = p tr (AA') ~ nN\ , 

t 

E ir? = tr (r“ = P* tr {AA'AA'). 

4 


(5.3) 
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The exact distribution of X'l, can Iw obtained n'udilv when p i,s evtai. 
case the iniimte intt'grid. 


(5,4) 


1 

27r 


r J-o 


(1 


'"dl 
■ (1 


i2irp 0 * 


In llns 


can be evaluated Ijy contour integration. The integral satistic.^ the conditions 
given in Whittaker and Watson (d, see, ()22), if the semicircle of the contour is 
taken on the lower half of tin* eomplex plnin*. 

Fur the case v ~ 2, for I'xamnle, there au’ simple poles, at t „ ,,, . 

The sum of the residue.^ at the.s(' jxile.s, multiplied by i yields the exaet di.striliu- 
tion; 


( 5 . 5 ) 


ai e 




2(0-1 — ffj) 


+ 


2(<rs — ffi) 


For even values of p greatei than 2, the values of the residne.s ean be obtairu'd 
by repeated differentiation. 


6 . Summary. We, are now in. a position to diseuss the ai)plieabiUty of the 
results of this paper to the problem which arises most freqm'utly in practice. 
The elements of the first approximation to the inveme will deviate fr(3m their 
expected values only because the first approximation ia carried to a lindteel 
number of places, say k. In this case the deviations will bt' tlf.slriibuted with 
constant density over a range of length 10"*. The elements of E, the. matrix of 
deviations, 

(6.1) E = A- - Co, 

are now each independently distributed, but with uniform density, range 10~* 
atid mean equal to zero. From (2.4) 

(6.2) D = AE, 

we observe that each element of D will he a linear combination of p independently 
and lectangularly distributed variables, each with mean zero and range 10~*. 
The analysis of sections 3, 4, and 5 will be valid if d.j ean be considered to be 
normally distributed. 

There is much experimental evidence and theorotieal justificatiim for ammin- 
ing that the elements of D are nornmlly diHtrilmted. A sufficient condition that 
the (Im approach normality as p increases is that the sum of the ttj/ in any row of 
A be divergent as the order of the matrix apprcjach infinitj', w’hile at tlie same 
time, every element be less than some constant value, indeiiendent of the order 
of the matrix [4]. 

The experimental and theoretical evidence supporting the, approach of the 
d,, to normality, the fact that the logarithms are insensitii'-e to errors of approxi- 
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mation in their arguments and the fact that the lower hounds to the proljability 
of convergence of the iterative process are used, all lend support to the formula 

k > logio m + logio V + login (p + 3) - .55 

for determining the number of places (k) necessary in the first approximation 
(Co) to the inverse of A, a matjix of order p whose elements have mean size ni, 
to make the probability at least .999 that the process of interation will yield a 
sequence of matrices which will converge to the true inverse. The ultimate 
justification of the use of this formula can only be by the results of its applica¬ 
tion in practice. 
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NOTES 


Thin ticdion is dcwlal to hrivf rrsrairh and rrpnmlon/ artirb -s, nolrs on rm IhwhihH/i/ 
and olhn short items 


ON DISTRIBUTION-FREE TOLERANCE LIMITS IN 
RANDOM SAMPLING 

Hr IIruuku'C Uoiuun.h 
P ost Grndiinle School, AtinnpoliH, Md. 

Let AL , ■ • • , Xn l)e indepeudent random vnnidilcs eacli with (lie ctititimioun 
and differentiable eunnilativo diatvibution funetion o-(j-) - Pr{X; < r). A 
continuous function f{x.i witli the propiudy that the raiidoin \’anablc 

K = <t(S{Xi , ■ ■ ■ , X„)) has a prohnbility dihtnluitiuu which is iudepcnulont of 
cr(j) will be called a dislrihution-Jrec. upper tolcroorr Imil^ (d. f. u. t. 1.). We 
shall prove 

Theobkm 1. A ncccssari/ and sufficient condition that the conthinous function 
/(■Ti ,•••,.«„) be a d. /. u. 1. L is that the. function 

n 

J{Xi , ' ■ • , Xn) — II {/($! ) ' ■ ’ ) Xn) 

>»1 

he iderdtcally zero. 

PnooF. Since f is continuous, we can prove the necoKSity of tlu' coudition by 
derivinp; a contradiction from the assumption that / is a d. f. u. t. 1. for which 
there exist distinct numbers dj, • • • , a„ such that f(ui , • • > , a„) » A a,-, 
(f = 1, • ■ ■ , n). 

Since the numbers Ui, • ■ • , , A are distinct, then* will exist a positive 

luimbcr e such that tlie (n 1) intervals 

I: A — e<x< A -ft 

a, ~f<x<ai+t (i = 1, , n), 

have no points in common. Moreover, since / is continuous, tlieire will cor¬ 
respond to e a positive number ei < < such that 

A - 6 < /(a'l, • • - , I,.) < A H- e, 
provided that simultaneously 

|.r:( ~ a. I < (i ® 1, • ■ • , n). 

Now let p bo uny number between J and Corresponding to p we, define 
the function <rp(r) as follows, In the interval I wo set = p, In every 
interval 

_ </,: a, — ei < a: :< a< 4- ei (i == 1, • • • , n) 

1 Cf . S. S. Wilks, Malhermlical StaMics, Princeton, University Press (1943), pp. 93-94, 
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we let aj,{x) increase an amount 



Outside the intervals I, J\, ■ ■ ■, !„ 


we define o.p{x) in any manner so that it is continuous, diflerentiable, and non- 
deereasing for every x, and has the properties (rp(— «>) = 0, trj,(oQ) = 1. It is 
clear that we can do this 

Let S denote the set of all points (a;i, • • , x^) of n dimensional space such 
that simultaneously 


Xi — a. 1 < 


(t = 1, • ■ ■ , n). 


Then by construction, for o-p {x) defined above, 
Pr((Xi,- • , Xp) e S) = 
But if (Xi, • ■ • , Xp) e S, then by construction, 


A - € < /(Xi, . - • , X„) < A + £ 


and 


Y = cMXx , • • • , X„)) = p. 

Hence for a{x) = <Tj,{x) we have 

= »> ^ (I)'- 

But since / is a d. f u. t, 1., this inequality must hold for any o- (a:) 

Now choose a set of numbers 

-J- < Pi < P2 < • • < Pm < -j, 

where m = 2(371)". Then from the above, 

Pr{Y = one of the numbers pi, • , pm) > 2. 

This is the desired contradiction. 

Let Or (ail, , a;„) be the function whose value is the rth term when the num¬ 
bers xi, ■ , Xn are arranged in non-decreasmg order of magnitude. In terms 

of the functions Or we can characterize the continuous functions / which satisfy 
the identity / = 0 as follows. Let i\, • , be a permutation of the integers 

1, ■ ,71 Denote by , ■ , z„) the set of all points (a:i, • , such that 

x,i < a:., < ■ • • < x.p. 

The n! sets E are open and disjoint Since / is continuous and / = 0, in each 
E{ii, • , In) we must have, for some r, 

f(xi , ■ ■■ ,x„) = 0r(xi , • • • , Xn), 

where the integer r = r(fi, ■ • , «„) must depend on the permutation ii, ■ • ■ , in 
in such a way that / may be extended continuously over the whole space. (The 
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conditioa for this is as follows. Two iiommlalions I'l, • ■ , ami > • ■ • , jn 
may be called adjacent if they differ only by an inieichange of two adjacent 
integers. Then for any two adjacent perninlations, eitla'i- rih . ■ • , — 

Tiji, ••• , jn) or the two rahies of r are the two interchaiiged integerH. For 
example, the function 

,, , xj) if riaf.'c, , j-2 , xs) /i 

, .rs, xjj - ^ ^ otherwi.se 

satisfies this requirement.) 

We shall now prove that the necessary condition, / r- (), of Theorem 1 i.s suf¬ 
ficient to ensure that the continuous function / he a tl. f. u. t. 1, From the. 
argument of the preceding paragraph, any eontinuous function / sueli that 
/ s 0 will in each set A’(A in) have the value fhCci, ■ ■ • , x„), where r i.s 

an integer from 1 to n. Since the variables A'l, • • • , Xn are indepi'iident and 
have the same probability distribution, the probability that {Xi , • ■ ■ , A',,) will 
belong to E{ii, • • ■ , i„) is equal to (l/a!) for every permutation p , • ■ , A - 
Let 

1F«/(AA, ... ,X„). 

Then if ip{x) = d(t{x)/dx denotes the probability density function of eaeli AA , 
the conditional p. d. f. of IF = OffXi, • •. , iVn), given that (A'’i, * > • , A''„) 
belongs to E(A , • ■ ’ , in), will be nl^rCui), where 

^ ^ <p(u))<r'“’N[lj- (r(w)r“' 

r)f • 

Thus fr(w) will be of the form 

^r{w) = <p(w)Fr(a(‘W)), 

where Fr(<r(w)) is a polynomial in tr(w). Hence the conditional p. d. f. of F = 
«r(lF), given that (Xi, ... , X„) belongs to /?(A , ■. • , ;„), will lie a!fr(?/), where. 

(r(i/) = K(i/), 

and the p. d. f. of F will be 

Ky) = S^’r(y), 

where the summation is over the a! integers r = r(A , • ■ • , ij. This is inde¬ 
pendent of a-(x), so that/is a d, f. u. 1.1. This complotea the proof of Theorem 1. 

A function/(xi, . >. , x„) is symmetric if its value is unchanged by any ixrmu- 
tation of its arguments. It is clear that the only continuous and symmetric 
functions f which satisfy the identity / e 0 are the n functions 0,(xi, ■ * > , x„). 
Hence we can state 

Theorem 2. The only symmetric d.f. u. i. Ids are the n functions Or(xi, • ■ ■ , Xn) 
(r = 1, ... , n). 
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A FORMULA FOR SAMPLE SIZES FOR POPULATION 
TOLERANCE LIMITS 

By H. Scheppe and J. W. Tukey 
Princeton Umversity 

In a paper to appear in a later issue of this journal dealing with various lesults 
on non-parametric estimation, we shall discuss in detail an approximate formula 
for the numerical calculation of sample sizes for Wilks’ population tolerance 
limits Because of the practical usefulness of this formula, it seems desirable 
to make it available without delay Its accuracy is adequate for all direct ap¬ 
plications 

An interval I is said to cover a proportion tt of a univariate population with 
cumulative distribution function F{x) if ^xdF = v. Let Xi, Xi, • • ■ , X„ 
be a random sample from the population, and Zi < < • ■ ■ < Z„ be a rear¬ 
rangement of Xi, As, • ■ , Xn ■ Define Zo = — “, Z„+i and consider 

the proportion B of the population covered by the random interval (Zj,, Z„_m+i). 
Then Pr{B > b\ is independent of F(x) if F{x) is continuous^ and equals 
1 — 76(71 — r-f-1, r), where r = k + m and /^(p, q) is K. Pearson's notation 
for the incomplete Beta function. 

Choose a confidence coefficient 1 — a, a pair of positive mtegers k, m, and a 
fraction h The sample size n for which we can make the statement “the prob¬ 
ability is 1 — a that the random interval (Zj,, Z„_m+i) cover a proportion b 
or more of the population” is then determined by the equation 

(1.1) Ib(n — r + 1, r) = a, 

where r = k m. Our approximate solution is 

(12) n =F |x'.(l + fi)/(l -b)+ i(r - 1), 

where xa i£> the lOOa percent point on the x^-distribution with 2r degrees of 
freedom The required values of Xa may be found for a = .1, .05, .025, .01, 
.005 in Catherine Thompson’s table [2], For this range of a, and for h > .9, 
extensive numerical calculations indicate that the error of (1.2) is less than one 
tenth of one percent, and is always positive, that is, n is slightly overestimated 
by (1.2). We have not yet obtained an analytic proof of this statement, which 
refers to the difference from the exact (and, in general, non-integral) solution of 

( 1 . 1 ) . 

A.S explained elsewhere [1], formula (1.2) may be used for Wald’s solution 
of the multivariate case 
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1 That the theory is valid in this case we show later. Previous proofs have required 
the continuity of F'{x) 
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A GENERALIZATION OF WARING’S FORMULA 

IlvT. N.K (liti.vn.M- 
Jiurmu of (hr, Cnisuti 


Waring’K formula (fHvjucrilly, liuf i‘oiTOflly, rullcil LufriHiiKc's fminiila) 
gives the polynomial of degree' n faking on s[>eeilierl vainer for ii 1 1 rlisfiuef, 
argumetiLs, If is freeiiiently iisi'il for iiiliTiiolatioii piiiiio'-e^ in tli'iiling with 
funetions for wliieh immerieul values aie given al uiie<iiial infe'r\aL. ’(’Ids 
formula may bo written in the form; 


( 1 ) 


/(•r) = Z 

tt«a 


f(a,) II 


where oo, aj, Uj, ■ ■ • , are the argiimenfs fen' wliieh the value of the poly¬ 
nomial /(i) is given. This forimila was lir.it piibli.slied l»y Waring !21 in 1771), 
and it was not until 1795 that Lagrange gave it in his liook: Lrfon.'.' Klnncntniirs 
sur Ics Malh6niatiqun 'hlie prominent British aeluiuy ami malhemntieian, 
Mr. D. C Fraser states that “there are identities of notation in (lie stalemeiil of 
the formula whie.h leavi* little ilouht that Lagrange wa.s simply i|iioting from 
Waring’s paper.” ^^''aling’s iniority was hruughi to my nttenfioii liy .Mr. Friuser 
and by Dr. W. hldwards Doming. 

If any two or more of the arguments n, aie eipial, the form fl) beeiiines iiidi'- 
terminate. However, the limiting value, lus m 1 speeilied arguments aiiproaeh 
a common value a, can he shown to lie an ('xi)re.ssion involving the first in deriva¬ 
tives of the polynomial f{,x) for (he argumeiif a. 'Phis ease of “refioiited argu¬ 
ments” is of considerable interest, e.speeially in eoiineetioii with (ho theory of 
osculatory, oi .smooth-juiietion interpolation [1, p. .’15). It is (he purpose of this 
note to generalize the foiinula (1) to the ease in which not only the value of 
f(x) but also of its fir.st m, derivatives are given foi each arguiiieiil- «, , The 

n 

degree of the polynomial ropre.senlecl, w'hich we .shall detiole liv .V, i.s n + Z »h • 
The generalized formula is: 


( 2 ) 


n P n / \ *^1" 

m = Z P.(.r - a.) n (•'' 


where Pi[x — a,) denotes a polynomial in — a, obtained by the following pro¬ 
cedure. First, J{x) i.s expanded in a Taylor series in powers of .c ™ «,. Next, 

^ Ct|\ ^ 

the expression ( 1 + -1 i.s expanded as a binomial series for every 3 

\ di (Ij/ 

different from i Finallj^ all the a + 1 expansions (a lunomial and one Taylor) 
are multiplied together, and all terms containing powei's of x — a, higher than 
vii are rejected. This formula has already been given by Hti'ffenson [1, p. 33] 
for the particular case in which every w,- = 1 
The general formula (2) is difficult to arrive at without a previous knowledge 
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of the result, but is easily shown to be the correct expression. Upon differentiat¬ 
ing k times (0 ^ A ^ mr) all the terms in the summation except the one cor¬ 
responding to i = r will contain the factor {x — and will therefore 

vanish for x = a, . Moreover, the non-vanishing term, before differentiation, 
will agree, up to and including terms containing (x — ar)'"'', with the Taylor 
expansion of /(x) in powers oi x — ar, since the product expression within the 
brackets will be exactly canceled, as far as terms of degree Mr , by the n binomial 
expansions Hence the fcth derivative of the non-vanishing term in the summa¬ 
tion will be (a,) for x = Or. This establishes the formula. 

This formula is clearly equivalent to the Newton divided difference interpola¬ 
tion formula with repeated arguments [1, p. 33], the argument a, occurring 
m, -1- 1 times. Therefore, if /(x) is any function other than a polynomial of 
degree N or less, it is necessary to add a remainder term [1, pp. 22-23] of the form 

Jn{x) n (^ - 

t«0 

where denotes the limiting value [1, pp. 20-21] of the divided difference of 
order N involving the arguments x, Oo, ai, ■ ■ , a„, with each argument a; 
appeanng m, -b 1 times. The existence of all the indicated derivatives is, of 
course, essential. 
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NOTE ON THE VARIANCE AND BEST ESTIMATES 

By H. G. Landau 
Washington, D. C. 

The purpose of this note is to point out a certain relation between the vari¬ 
ances, <ri and al , of the random variables, xi and X 2 , and the probabilities, 

Piil) = Pr[ I xi - Eixt) I < t] 

PsCO = Pr[ IX 2 — E(x 2 ) I < (]. 

This is, ii o-I < tri , then Pi(i) > P^it) m at least one interval, k < t < t 2 . 

A note by A. T. Craig [1] gave an example for which it was stated that al < al 
and Pi(0 < P 2 {t) for every i; but, as was pointed by Neyman [2], calculation of 
the probabilities involved shows the statement to be mcorrect. 

The present result provides a certain justification for the use of minimum 
variance estimates by assuring that no other estimate with the same mean can 
have, for every value of t, a greater probability of a deviation from the mean 
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less than (. If an cstinialc can be ftmtul which lias a greater valnc of P{1) for 
all I than does any other cstiinatn, it is nccf'ssarily the niiniimnn variance 
estimate. 

The theorem Ijclow inoludes a similar relation for equal vanatice.s. This 
theorem can ho obtained from known general results on ineqnulitie.s for distn- 
biitions detennined by moments, [3] and [4]. 'I'he formulation given hi-re witli 
its significance for estimates does not apiiear to Inua* been reniark(‘d. 

I'hkoiiem. If Ihc random vartnblfa, ci oiid .cj , hntr Jinitr ranVmrcs, tr? and 
(Tj, and 

2 ^ S 
iri < tTi , 

then, either 

Qii) - Pxit) - 

is equal to zero at all-points of coniinuUy, which ran occur only for (rj — irs , or (here 
is an interval, k < i < , in which Q(l) is positive. 

Proof. We write the variance as the Htieltjes integral, 

/tO0 

ir? = / edPxit), 

JQ 

and similarly for o-j. 

Let 

S(T) = r C-dl\{t) - f edPtit) « f CdQil) 

Jo ^0 *’0 

= r^QiT) - 2 r lQ(i) dl, 

Jo 

integrating by parts. 

Now 

ni - p,(r)i = T^J^dPiit) < j" edi\{t), 

/ w 

t^dPi{t) 0 as 2’ so that lira 2'’'(1 - 2^(^)] 

*’ 7'-^93 

= 0, and similarly for Paft). 

Hence T Q(T) = T\l —^Ps(2')] ~ 2’^[1 — 2’i(r)] —♦ 0 oh 2' - > andsineo 
by definition lim <3(2’) = ^ ^ g-l it follows that 

al - 4= -2 [ lQ(^l) dl. 

From this it can be seen that either, Q(t) vanishes at all points of continuity, 
in which case ci = 4 , or Q{f) must be positive in some interval, since other- 

^ee * 

vise tQ(i) dt must be negative and hence <ri — 4 ^ 0 contrary to the ossump- 

tlODj O'! ^ (72 m 
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Personal Items 

Dr. 11. Ij. Andei.sim, on leavp from Dip Ntn-th t'iirnlimi State t'ollpgp, i.s 
.serving as a rp.sptu’pli mathonnUician on a war rp.«parph project .at Princeton 
Urvivorsiiy 

Profe.s.S()r Kenneth .1, Arnold, on leave from iho Kniver.sity of New Ilaiiip-slure. 
is doing war lUscareh in the Stati-stieal Re.seareh (Iruup, at ('olnndiia Cniversity. 

Dr. W. J. Dixon, on leave from the Dnive.mity of Oklahoma, le .sla ving a.s a 
rc..searoh mathematician on a war re.seareh project at Princeton ^ni^'el■sity. 

Air 11 M. PoiStev of Bell Telephone Lahoratories has heen appointed piofe.ssor 
and head of the department of mathematic.s of the Polytechnic Institute of 
Brooklyn. 

Dr. Hilda Geivingcr, Heeturer at Bryn Alawi College, lia-s heeu ajiiiomted 
Prol'e.s.sor of MathemaUc.s and Hoad of the Alathematie.s 1 )(>partmenl ai Wheaton 
College, Norton, Ma,s.sachuriet.tH. 

Assistant Profos.sor E 11. C. Ilihlehramli of llie Stale 'I'eaclieis College, 
Upper Montclair, New Jenoy, has liei'ii appointed to an a-ssislaiit proi'f^sor.sliij) 
at Northwesti'i'ii UuivevHity 

Mr. John E. Kenney of the rni\oi’sity ol lYKconsin has heen promnicd to an 
asrsisiant professor,ship. 

Assistant Professor B. A Kuowler of the rnivemity of low a luis heen promoted 
to an associate profc-ssorslup. 

Dr. Saul B, Sells is now Head Statistician of the. Statistical Slandard.s Branch, 
Office of Price Administration, Washington. 

Mr Waltei H. Thompson, formerly an insLuictoi at Mi'giiiia Polytechnic 
Institute, is now associated with the Kcllex (Jorporatioii, New York 

Professor Helen M, Walker of Teachei.s (tollege, Coluiuhia rnivei-siti’, has 
been cleotcd president of-the American Statistical A.ss()eialloii. 

Professor C. C. Wagner of Pennsylvania State College lui-s lu'eii appointed 
as.sistant dean of the )School of Liberal Arts. 

Dr. Edward Holly of the Illinois Institute of 'recluiologv died November 28, 
1943, 


New Members 

The following peraona have been cleetod to lunmborship in the liiatilvUi". 

Andrews, T. Gaylord. I'h.D. (Nebniska) IiiHlrueUir in Paycliolngy, Buniiud UuIIcko, 
Columbia University, Now York City. 

Angell, Dorothy T. Memberof Technical Stall, BellTcloplunu' Laboi'nlorioa. Murriiy HilL, 
New Jeney. 

Barnes, John L. Member of Teehtucal Staff, Bell Telephone Laboratorie.s. 81 North 
Cherry Lane, Rumson, New Jersey, 
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Bloom, Rose. BA (Iluulor) Pvt , Billings General Hospital, Ft Beiij Harrison, Indiana 
Bonnar, Robert Underwood. M.S (Univ ol Washington) Associate Chemist, Bureau of 
Ships, Navy Dept Whiteslone Road, Silvcrspring, Maiyland, 

Brearty, C. R. BS (Ctalifornia) Officer in Charge, Quality Control Section, Signal Coi ps 
Inspeetioii Agency 1.9 IFcsl St , Dayton 2, Ohio 
Campbell, George Clyde. M S. (Iowa) Captain CWS Chief, Fiscal Div., Pine BlulT 
Arsenal. Troy Road, RFD j^l, Boonlon, New Jersey. 

Clifford, Paul C. AM ((lolumbia) Asst Prof ofMath.,StateToachcrsCollegn,Mont- 
elaii, New Jersey. 541 Uppei Mountain Aue 
Cobb, William J Statistician, Census Bureau 40S8 8lh St , NE, Washington, D. C. 
Coggins, Paul Pond. M A (Harvard) Accountant, .American Tel and Tel 195 Broad¬ 
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REPORT ON THE WASHINGTON MEETING OF THE INSTITUTE 
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All sassione were liehl jointly with the Ameiicun Hintistleal .Wtoeiiition. 

Professor Will Feller of Brown Uiuversity luiled iw C'huinniin for the Saturday 
afternoon session, The following papers were presented: 

1 Elements of the Theory of Testing Ifyyolhrsrs. 

J. 11 Curtiss, Jr, Navy Department 

2 Large Sample Tests of Statistical Hypotheses. 

Abraham Wnld, Columbia University 

Professor Frank Weida of George Washington University acted as Chairman 
for the Sunday morning session. The following contributed papere w'ere 
presented: 

1 On the Sialisiics of Sensiltvily Data. 

C, West Churchman and Benjamin Epstein, Fruiiktord Atseiiul iviul the Hmversity ot 

Pennsylvania 
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3. Distribution of Sample Variances and Covariances of iSformallg dhslribulcd .\'oncentral 
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4. An Application of the Variate Difference Method to Multiple Regression, 

Gerhard Tintner, Department of Agriculture 
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Professor Samuel S Wilks of Princeton I'^niversity acted as Chairman for the 
vSimday afternoon session. The following papeia weio pre.sented' 

1 Retju’ssion PiiMem&m Time Sei les 

Tjiilluig Koopinans, Combined SliippinR Adjustment Board 

2 [I'oundatiorifi of the Theory of Time iScurs. 

J L Doob, Navy Department 

The bu.sine.sa meeting of the Washington Chapter of the Institute was held 
Sunday morning. The proposed Constitution of the Washington Chapter was 
ratified, and elections under this constitution were held for the first time. The 
following ofhcei-s were elected; 

William G Madow, Census Bureau—3 year teim, Secretary of the Program Committee 
1944-45 

Solomon KuHbnck, War Department—2 year term 

Frank Weida, George Washington University—1 year term. 

W. G. Madow 
Secretary, Program Committee 
Washington Chapter 




THE ELEMENTARY GAUSSIAN PROCESSES 

By J. L. Doob 
University of Illiruns 

1. Introduction 

One of the simplest interesting classes of temporally homogeneous stochastic 
processes is that for which the distributions of the defining chance variables 
|3:(0] are Gaussian. It is supposed that 

(A) if /i < • • • < i, , the multivariate distribution of x(ti), ■ ■ ■ , x(t,) is 
Gaussian/ and that 

(B) this distribution is unchanged by translations of the i-axis. 

The process is jV-dimensional if x(t) is an A-tuple xi(i), ■ • ■ , xiv(t). The means 
are independent of t, and will always be supposed to vanish in the 
following discussion. 

The correlation matrix function (r,j(i)) is defined by 

(1.1.1) r,j(t) = S{x,(s)x,(s + 01. 

This expectation is independent of s, because of condition (B). The matrix 
function E(t) satisfies the equation 

(1.1.2) r„(0 = hf = 1, ■■■ , N. 

It follows that when < = 0 the matrix is symmetric: 

(1.1.3) fvXO) - r,.,(0), = 1, ... 

and it is also well known that R[Q) is non-negative definite. Conditions on the 
functions r./t) necessary and sufficient thkt 12(0 be the correlation matrix 
function of a stochastic process were found for the case ^ = 1 by Khintchine’ 
and for all N by Cram4r.‘ 

Hypothesis (A), that the process is Gaussian seems at first a restriction so 
strong that Gaussian processes are ummportant. These processes are, however, 
of fundamental importance, for the following reasons 

(i) If i2(0 is the correlation matrix function of any temporally homogeneous 
stochastic process, there is, according to Khintchine and Oram4r, a Gaussian 
process with this same correlation function This Gaussian process is uniquely 
determined by the correlation function (assuming that all first order moments 
vanish, as usual). Because of this intimate connection between the temporally 
homogeneous Gaussian processes and the most general temporally homogeneous 

‘ Singular Gaussian distributions will not be excluded. For example the a:(i/) may all 
vanish identically. 

* The expectation of a chance variable x will be denoted by jB(xl 

* Malemalische Annalen, Vol 109 fl934), p. 608. 

* Annals of Math , Vol 41 (1940), pp 215-230. 
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processefi, it is not surpnsing that very few facta are known about specifically 
Gaussian processes, that is facts which are true of temporally homogeneous 
Gaussian processes, but not of temporally homogeneous proceasea in general. 

(ii) It follows from (i) that in any investigation of temporally homogeneous 
stochastic processes involving only first and second momenta—for example 
least squares prediction by linear extrapolation—it may be asHumed that the 
variables are Gaussian. Under this hypothesis, the investigator may be helped 
by the suggestive specialized interpretations possible in the Gaussian case of 
results which hold in the general cose. For example if iV = 1, the least sriuares 
best prediction in the Gaussian case for x[n + 1) in terms of a linear combination 
of the variables a:(l), ■ • , x{n) is the conditional expectation of z{n + 1) for 
given 2 :( 1 ), • ■ ■ , x(rt), which is the least squares beat prediction of x(n -f 1) 
in terms of i(l), • ■ • , x{n) with no restriction on the functions involved. Thus 
the linearity of the prediction, which must be. part of the hypoth^is in the gencf- 
ral case, is automatically true in the Gaussian case. There, is necessarily a linear 
least squares best prediction of x{n + 1) in terms of the complete past 
• • • , x(n - 1), x(n) since the corresponding conditional expectation is certainly 
defined in the Gaussian case, and is linear in that case. 

(lii) In many appheations, there is a real justification for hypotluisis (A) that 
the process is Gaussian. This is so in certain physiral studies, for example, 
because the Maxwell distribution of molecular velocities is Gaussian, K,xampleH 
will be given below. 

The processes discussed in the present paper are all temporally homogeneous 
Gaussian processes. Most of the theoreniB will be valid for any temporally 
homogeneous processes for which the second moments of the variables exist,'' 
with the following changes: independent chance variables which are linear com¬ 
binations of the x(8) will become merely uncorrelated chance variables; the 
convergence with probability 1 of a series of such chance variables will become 
merely convergence in the mean; the conditional expectation of one such variable 
y for given values of others, j/i, j/i, • ■ • will become merely the linear approxima¬ 
tion 2 o-iUj of y in terms of the yj which minimizes 

Sfll/ - Z ayj/yn, 

i 

that is to say the conditional expectation becomes the least squares linear 
approximation. 

The following theorem and its corollary are fundamental in the study of linear 
prediction involving infinitely many variables. The results are implicit in much 
of the work on the subject but do not seem to have been stated explicitly before. 

Thborbm 1.2. Let • ■ • , xo, ii, • • • he o sequence of one-dimensiondl Gaussian 


‘ The proeesses need not even be temporally homogeneous. It is necessary only that 
and El*(«) ®(s + t)} be independent of *. 
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chance variables mih Ihe property that if ni < 
button of , ■ ■ ■ , x„^ IS Gaussian and that 

(1.2.1) E{-- ,x„_i,x„,x„] = x„/ 
whenever m < n. Then E\xm\ = a is independent of m, and 

(1.2.2) ■. g E{(x^ ~ a)’l ^ El(x„+t - a)*) g ■ ■ 

If the (XrtJ are defined for all negative integers, 

(1.2.3) lim Xm = 


< n,, the muUivanaie distri- 


exists mih probability 1 and 

(1.2.4) hm - x„)*) = 0. 

If the (xn) are defined for all positive integers, and if the dispersions in (1.2.2) 
form a hounded sequence, 

(1.2.3') lim Xn = 

m-*« 

exists mth probability 1, and 

(12.4') hm £?{(a:. - x„)*! = 0.’ 

m-*oo 

It follows from (1.2.1) that 

(12,5) E(x„l =E(E{x„;x„S) = S{x„j. 

Hence ■ ■ = E[xo] = E{xi} = ••• . It will be no restriction to assume from 
now on that 


■■• = £{xo! = = ••• = 0. 

It also follows from (1.2.1) that 

(1.2.6) ; x,nx„} j = E{x„,E{x,nx„\] = E{xl,\,^ 

Using this equation, 

(1,2 7) E{xU = iJ{[(x„ - xj + xj] = E{ix„ - x„f\ + E[xl\, 

and the dispersions of the thus form a monotone non-decreasing sequence. 


• The conditional expectation of a chance variable y for given values of a chance variable 
t) will be denoted by Birf, j/j. 

’ Much of this theorem remains true if (1 2.1) is true but only the first moments of the 
x„ are supposed finite, no other hypothesis being made on their distributions. Cf. Doob, 
Am. Math. Soc. Trans., Vol. 47 (1940), pp. 4^-460. 

' Alternatively, (1,2.1) implies that Xn — x„ is unoorrelated with . Then 

+ (®n - *n)*m) = 
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Finally, using (1.2.6), 

(1.2.8) Xm){^b+1 S',) 1 — 0. 

The series 

(1.2.9) Z (aWii - ^«) 

m 

is therefore a series of mutually independent chance variahlen. According to a 
well known theorem of Kolmogoroff, a sequence of mutually indcfrt'ndent chance 
variables converges with probability 1 if the means and disirersions form a con¬ 
vergent series. The present theorem follows at onc.r* frJim Kolrnngoroff’s 
theorem. 

CorolijAHY. Let x be a one-dtmennotval Gaimian chanri’ t>anal}le, and let 


( 1 . 2 . 10 ) 


2*01 » » * * * 
2-11 1 2^15 I * ’ * 

xji, Xn , * * ’ 


be sequences of one-dimensional Gaussian chance, variables with the properly that 
if V ^1, the mvliivariale distribution of x, Xr,i, ■ , x™, is Gaussiar\, and suppose 

that each variable Xmn is a member of every later sequenc.e. I'ben 


Urn E\x„i,x„i, ;x] « x- 

(1.2.11) 

lim x»j, '••;*) ^ 

iH—s\sn 

exist with probability 1, and in the mean, and 

(1.2.12) x+ - E{x„n ,m = 0, d=l, • ■ • , n = 1, 2. ■ • • ; x). 

It will first be shown that the sequence {x„), where 

(1.5.13) Xm = Flx„i, x„s, • •• ; x}, 

has the property demanded in the theorem. In fact, from the definition of 
conditional expectation, the difference x — x„ has expectation zero and is in¬ 
dependent of the variables {x„/l for m ^ n, and therefore of the variables 
■ ■ ■ , Xn_i, Xn. Hence 


(X - X«) - (X - Xrt+j) = Xm-i - 

has expectation zero and is independent of the variables • < • , Xn-i, x^, There¬ 
fore the sequence lx„ 4 i — x„) is a sequence of mutually independent chance 
variables with vanishing expectations. This implies (1.2.1) if m < n because 

El\--’ ,x„\x„\ =» , X„ ;x„ ■+• 2 (xy+i - Xy)| , x„ ;x,«) 

(1.2.14) ^ ^ 

n—1 

* j Xm ; Xfi-i ' X/) — Xif* • 
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Let a be the common value of ^^{ 2 :), £{ 0 ;^} Since x — x„v is independent of Xm , 

(1.2.15) E[x„ - a)“) + B{{x - = E\{x - a)“}. 

Hence the sequence of dispersions of the Xm is bounded and according to Theorem 
1.2 the limits x_ and x+ in (1 2.1) exist with probability 1 Since x — has 
expectation zero and is independent of Xmj for m g n, x — x+ also has expecta¬ 
tion zero and is independent of for all m, that is (1.2.12) is true. 

The simplest non-trivial special case of this theorem is the following: 
Let Xi, Xj, • ■ • , zbe one-dtmensimal Gaussian chance variables mih the property 
that if y ^ 1 the multivariate distribution of x, Xi, • • • , x, is Gaussian. Then 

(1.2.16) limiSfxi, x„ , x) = £{xi, X 4 x}, 

mlh probability 1, and this limit is also a limit in the mean. 

As stated, the theorem and corollary are true without the hypothesis that the 
chance variables concerned are Gaussian (The existence of second moments 
must be assumed if the limits are to exist as limits in the mean) They are 
stated for Gaussian variables because the proof is simple in that case, and be¬ 
cause that is sufficient for the purposes of this paper 
In discussing t h G processes whose parameter i is not restricted to be integral, 
the usual continuity hypothesis will be made. It will be supposed that S(t) 
is continuous at i = 0: 

(1.3.1) lim [i?(0 — ff(0)] = —^hm E([x(t) — x(0)f) = 0. 

t -»0 (-*0 

It is then easily concluded that E(0 is everywhere continuous. 

In the continuous parameter case, it would be useful to have the conditions 
on E(t) necessary and sufficient for the continuity in t of the chance variables 
x(t) and for the existence of the derivative. No set of necessary and sufficient 
conditions for the continuity of x{t) is known, although the fact of continuity 
will not be difficult to prove in the special cases to be considered in §4. The 
conditions for the existence of x'(t) are quite simple, and will be given in Theorem 
1.4. 

The spectral function of a one-dimensional t.h.G. process will play an essential 
role in some of the theorems to be discussed below. If R(n) is the correlation 
function of a one-dimensional t.h.G. process, R(n) can be expressed in either 
of the forms 

(1.3.2) R(n) =! f cos n\dF(\) n = 0, ±1, , 

JO 

R(n) = £ dGiX) 


(1.3.2') 


n = 0, ±1, • • ■ , 
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where, F(X), called the spectral function of the process, and called the 

complex spectral function of the process, aif> real monotone non-decreasing 
functions satisfying the following conditions: 

P(0) =0 G{-t) ^ 0 

(1.3.3) h\\-} = F(\), ()< X < X, (?(X-) - r/(X), < X < T 

f?(x) - r/(0-f) - f/(0) - x+) 

FW) = GM 

(1.3.4) Fix) = GiX) - Gi- X-f-) = 2G(X) ~ G{0) ~ 6'(()-|-), ()< X < r 
F'iX) = 20'(X)’ 


The last equation of course holds only at points where, the derivatives exist. The 
forms (1.3.2), (1.3.2') are derived trivially from each other. The correlation 
function determines the spectral functions uniquely, if the latter are supposed 
to satisfy (1.3.3). In fact, at the points of continuity of X’(X), GiX)-. 


(1.3.5) 


GiX) « 


x/e(o) 




n 


(X + x)«(0) , 1 ^ 

9lim /i:(n) 

—jr 71 

HftO 


2x 


Conversely if any FiX) or (7(X) satisfying the stated conditions is used to deter- 
mme an Rin) by means of (1.3.2) or (1.3.2'), /i;(n) is the correlation function of a 
t h.G. process. The representation of Rin) in terms of f/(X) is frequently more 
convenient than that in terms of f(X), because of the simple proixirtiea of the 
exponential function. The following relation, which will be used below, exhibits 
the elegance attained by the use of GiX): 


(1.3.6) 


i?([Ec:x(m)]-tl:c'„'x(n)]) = S 


c„ c„ Rim 


n) 



The correlation function of a one-dimensional continuous parameter t h G 
process can be represented in either of the following forms: 


(1.3.7) 


Rit) = jf cos iX dFiX) 


(1.3.7') 


m = f e*'" dGiX) 


•H. Wold, A Study in the Analysis of Stattonery Time Series, Uppsala, (1038), p. 66. 
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where the spectral function F{\) and the complex spectral function G(X) are 
monotone non-decreasing and satisfy the conditions 

F ( 0 ) = 0 G (-«>)=0 

(1,3.8) nx-) - 0 < X < 00 G(x^) = 6(\) 

G(X) - G(O-f) = G(0) - G(- \+) 


F{ao) = G{oo) 

(1.3.9) Fix) = G(X) - Gi- X+) = 2G(X) - G(0) - G(04-), 0 < X < oo, 
F'(X) - 2G'i\). 

The last equation of course only holds at points where the derivatives exist 
The correlation function S(0 determines the spectral functions uniquely if the 
latter are supposed to satisfy (1.3.8). In fact, at the points of continuity of 
Fix), GiX): 


2 /■" r,,,. sin tX 
Fix) = - / Rit) —— dt 

T JQ t 

GiX) = lim i r Rii) ~ dt + G(0). 

Jtin J—>T t 


(1.3.10) 


Theorem 1.4 Lei {a:(01 be the variables of a one-dimensional continuous 
farameteT t.h.O. process with correlation function Rit) and spectral function F(X). 

If 

(1.4.1) [ X’dF(X) < 00 

Jfl 


(i) R'it), R"ii) exist and are continuous, and i?'(0) = 0; 

(U) xit) is an absolutely continuous function of t, with probability 1; 

(iii) for each t, 

(1.4.2) lim + ^ - = x'it) 

h^Q h 

exists, with probability 1, and this convergence is also true in the mean; 

(1.4.3) lim _ a:'(oJ| = 0; 

(iv) the x'it) process is a t.h.G. process, with correlation function —R"it) and 

spectral function / X“dF(X). 

Jo 

Conversely if 

(1.4.4) lim inf = .jiim inf E /r^i^ - ^ 0) T\ < „ ^ 

n A-*o I^L ^ J j 

then (1.4.1) is true. 


(1.4.2) 


(1.4.3) 


(1.4.4) lim inf = .jiim i^f e[\^- 

n A-*o I^L 
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Thifa theorem is due to Slutsky. 'I'he proof will be sketehed here, for com¬ 
pleteness, (The hypothesis that the process is a Gaussian process is immaterial, 
since only the second moments are involved in the proof.) 

Proof of (i). If the integral (1,4.1) exists, i^'(0^ H"(0 can Iw obtained by dif¬ 
ferentiating under the integral sign m (1.2.2); 


(1.4.5) 


R'il) = -j[ k sin dF{\) 
R"{i) COB tX df’(X). 


Then R''iL) are continuous functions, and ii'(O) = 0. 
Proof of (it), (iii), (iu). The quantity 


(1.4.6) 


E 




x(i + fli) — x(l) 
hi 


x(t + hi) ~ 


can be evaluated in terms of the correlation function /?(£), and approaches 0 
with /ii, , if the second derivative R"{t) exists. There is therefore a chance 

variable y{t) to which the difference quotient converges in the mean: 


(1.4.7) 




The j/(0 process is a t.h G. process. Moreover the equation 


(1.4.8) £;(x(3)i(3 -b 0} = R{t) 

can be differentiated to give 


(1-4.9) E[x{s)y{s -f £)1 = 1 S{j:( 8 — £)y(s)j = R'{t) 

and this in turn Vhen differentiated becomes 


(1.4.10) £'ly(s - t)y{s)\ = E{y{s)y{s + 01 = 

Hence the y{t) process has correlation function — ft"(£). Finally.^ 

EjlifO - x(0) - /‘y(8)d8T| = E{[%{1) - i(0)]*) 

(1.4.11) ^ ^ ^ 

+ jf j[ {v(.s)vis')] dsds' “ 2 jf ii'([a?(0 - 3!(0)]y(«)j ds * 0, 

(evaluating the right side of (1.4.11) in terms of R{i), R'(t), R"{t)). Thus *(0 
is absolutely continuous, with probability 1, and y{t) is the derived function 
x’it). Hence x'{t) exists for almost all £, with probability 1,*“ It follows (Fu- 
bini’s theorem) that the limit in (1.4.2) exists for each I, with probability 1, 
except possibly for a £-set of Lebesgue measure 0. Since the process is t.h., the 


For the exact meaning and measure-theoretic justification for statements of this type, 
see Doob, Am. Math. Soe. Trans., Vol. 42 (1937), pp. 107-40 
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exceptional set must be either empty or the whole /-line. The exceptional set 
is therefore empty. 

Conversely if (1.4.4) is true, (1.4.1) follows at Mice from (1.3.7), 

It will be convenient to use condensed notation below. If x: (21, ■ • • , Xs), 
y- iVii ' " , Vn) are iV-dimensional vectors and if A\ {aij) is an fV-dimensional 
square matrix, x y will denote the matrix (xty,), Ax the vector with components 
2 o.yx,’ and {x, y) the number . The adjoint matrix (oi/): a,, = 

1 ' 

ivill be denoted by A*. Throughout this paper, the chance variables will be 
real-valued, but it will be convement to use complex constant vectors. The 
identity matrix will be denoted by I. It will be convenient to denote the i, jth 
term of the matrix A by (A).y. The following equations will be used frequently; 

Ax-By = A{x-y)B*, (Ax, y) = (x, A*y). 

If X is a chance variable, it is clear that j^[x-x} is a symmetric non-negative 
definite matrix. 

The simplest Gaussian processes are those in which the distribution of future 
states IS based not on the complete past, but only on the immediate present. 
The precise definition of this (Markoff) property is the following. 

(C) If /i < ■ ■ ■ /,+i the conditional distribution of i((k+i) for given values of 
x(/i), • • • , x{t,) depends only on the value assigned to *(/,). The conditional 
distribution of x(f»+i) for given values of x(/i), • ■ • , x(i,) will then be simply the 
conditional distributioh of x(/n.i) for the assigned value of x{U). 

The processes to be discussed in this paper are the processes with properties 
(A), (B), (C): temporally homogeneous Gaussian Markoff (t.h.G.M.) processes. 
The properties of t.h G M. processes will also be used to derive properties of the 
moat important simple types of one-dimensional t.h.G. processes—those with 
rational spectral density functions. Some of the results are contained implicitly 
in the work of previous writers, but the presentation of the results has in all cases 
been chosen to stress their specific probability significance, and may therefore 
appeal even to readers familiar with previous work. 

The condition (C) on a Gaussian process is equivalent to the condition (C') 
that if ti < • • < 

(1.5.1) E[x{i{), , x((,); x(/,+i)} = E{x{t,)-, x(t,+i)j. 

In fact (C) is at least as strong as (O')- Conversely if (O') is true, 
x(t,+i) = x(<,H.i) - B(x(i,); x(t,+i)) -1- E\x{l,)] x(tv+i)} 

(1.5.2) 

= y + E\x{t,); x(i,+,)), 

where y is a Gaussian <jhance variable with mean 0 uncorrelated with and 
therefore independent of x(/i), • ■ • , a:(/»), and the last term of (1.5.2) is simply a 
multiple of Then the conditional distribution of x(<,+i) for given x(<i), 

• • • , x(/,) is a Gaussian variable, with mean E[x{t ,); x{t ,^\)) and dispersion that 
of y. Since this conditional distribution depends only on x(/,), property (O') 
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implies property (C). Hence these properties are equivalent, The condition 
(O') can be ■written in the form 

(1.5.3) E[x(t), t 8\ x(s + 0) == E{x(s); x(s + i)), I > 0. 

In many applications the stochastic processes either have this property already 
or will have it if the dimensionality of the processes is increased by the adjunc¬ 
tion of auxiliary chance variables. In the latter case the process is called a 
component process of a t.h.G.M. process. Component processes are discussed 
in detail below. If a process is a t.h.G. process, the right side of (1.5.3) is a 
linear transfo^Tnation (depending only on 1) of x(s): 

(1.5.4) ^'{*(s); <)1 == A(f)i(a), I > 0. 

The matrix function A(0 -will be called the transition matrix function. It 
satisfies the equation (obtained by performing the operation £'{x(s)- ] on both 
sides of (1.5.4)) 

(1.6.5) R{i) = RiO)Ait)*, t > 0, 

but is otherwise unrestricted since if (1.5.5) is true, the difference x(l) — A(0x(s) 
is uncorrelated with and therefore independent of xis). In many applications 
the elements of R(i) will vanish identically except in square matrices down the 
main diagonal. If this is true, A(0 can also be assumed in this form. 

If the variables |x(01 determine an iV-dimensional t.h.G.M. process, and if B 
is a non-singular i'l-dimensional square matrix, the variables {flx(()) also de¬ 
termine a t.h.G.M, process. Two processes connected in this way will be called 
equivalent. If two t.h.G. processes are equivalent, and if one is a Markoff 
process, the other must be also. If there is a change of variable 

(1.5.6) V(() = Bx{l) . 

taking the th.G.M. x(i) process with transition matrix A(0 and correlation 
matrix R{l) into the equivalent y{t) process with transition matrix Ai(i) and 
correlation matrix Riii), then 

(1.5.7) Ai{t) = BA{l)B-\ R^{t) = BR(,t)B'<‘. 

If (®(01, (?/(01i {*(0! determine t.h.G. processes of dimensions a, (3 and 
a -f (3 respectively, if the process determined by 

{a:i(<), ••• ,x«(0, Viit), ,2/|s(0) 

is equivalent to the z(t) process, and if every x(8) is independent of every 2/(0) 
the 2(0 process ■will be called the direct product of the x(0 and 2/(0 processes. 
The extension of the definition to direct products of more than two processes 
is clear. If the x(0 and y{t) processes are Markoff processes, their direct product 
is also a Markoff process. Conversely if the 2(0 process is a Markoff process, 
the factor processes must also be Markoff processes. The following facts about 
matrices will be used below. If A is any A^-dunensional matrix, there is a non- 
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singular iV-dimensional matrix B such that B~^AB is m Jordan canonical form: 
the elements of B~^AB vanish except for those in certain submatrices down the 
main diagonal. Each of these submatrices has the form 


/X 

0 • - 

- 0\ 


X 0 • 

: “ 

\0 

• o 

1 X/ 


or simply (X) if it is one-dimensional. The X’s are the characteristic values of A, 
that is the roots of the characteristic equation det. | A — XT' | = 0, and the sum 
of the dimensions of the submatrices with a given X is the multiplicity of X as a 
root of this equation. The matrix A is said to have simple elementary divisors 
corresponding to a given root X of the characteristic equation if the submatrices 
in (1.5.7) with that X are all of dimension 1 Thus orthogonal matrices, sym¬ 
metric matrices, and skew symmetric matrices have only simple elementary 
divisors, since they can be put in diagonal form, (with X’s of modulus 1, real, 
pure imaginary, respectively). The transformation B and the X’s may not be 
real. If ri. is real, however, there is a real matrix B such that the elements of 
BT^AB vanish except for square submatrices down the mam diagonal, and the 
characteristic roots of different submatnces are neither equal nor conjugate 
imaginary. 

The powers of a matrix in Jordan canonical form are easily calculated using 
the fact that 



/x 0 • • 


" /X” 0 • 

• ® \ 

(1 5.9) 

jl X 0 • 

■ o' 

1 _ /nX”-’ X" 0 

• “ 


\o • • 0 

1 x/ 


nX"-' X"/ 


It follows that in the general case the elements (A")v, are linear combinations 
of X," , nX" , etc , where Xi, Xs, ■ • • are the characteristic values of A . Hence 
if (d ."),3 —> 0 as 71 00 , the approach must be exponential The terms of d," 

certainly go to 0 if all the characteristic values of A have modulus less than 1. 

The matnx is defined by the usual series formula for the exponential func¬ 
tion. If A has the form (1.5.8), e*'* can be calculated using (1.5,9); 


( 1 . 6 . 10 ) 



It follows that in the general case the elements (e*'*),, are linear combinations of 
, etc. where Xi, Xj, ■ • are the characteristic values of A. If (e‘"‘)i, 0 

as < ^ 00 the approach must be exponential. The terms of e*'^ certainly go to 0 
if all the characteristic values of A have negative real parts. 
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A t.h.G.M. process will be called deterministic if the least square^ prediction 
of x(s + t) for given x(s), [1 > 0), that is l?f 2 (s); i(s + i)) is always correct; 

(1.6.1) J(s + 0 = A(t)a;(s) I > 0, 

with probability 1. 

The following classification of detenninistic proceK.so.s will be useful later. It 
will be shown that any t.h.G.M. process is the direct product of processes of the 
following four deterministic types, and of a factor process with no deterministic 
factors. 

M(0). Let (a:(i)} be the variables of a one-dimensional t.h.G.M; process, 
with x(t) = 0 with probability 1. (The chance variable which is 0 with prob¬ 
ability 1 is considered as a Gaussian variable with mean 0 and dispersion 0.) 
The correlation function of the process vanishes identically. 

M(l). A one-dimensional t.h.G.M, proce.ss which satisfies 

(1.6.2) x(t) = x(0), £{x(01 = 0, S{x(0’l > 0, 

will be called a process of type MiX). The correlation function R{t) is positive 
and independent of t. 

M(— 1). A one-dimen.sional t.h.G.M. process with an integral-valued param¬ 
eter 71, satisfying 

(1.6.3) • = x(-l) = -x(0) = x(l) = • U(x(ti)1 = 0, > 0 

will be called a process of type Af(—1). The correlation function is alternately 
positive and negative: R{n) = (—1)’’>R(0). 

Jlf(e'*). A two-dimensional t.h.G.M. process with 

B(xj(0)! = 0, £Hij(0)*j = a* > 0, Blxi(0)x,(0)i = 0, 

(1.6.4) Xi(0 = Xi(0) cos t6 — X2(0) sin tO 


Xi(£) = xi(0) sin tS d- Xj(0) cos td, 

will be called a process of type The correlation function is given by 


(1.6.5) 


_ / <7^ COS W sin t6\ 
\—sin 18 0 -’ cos (0/ ■ 


A process with variables (x(<)) will be called degenerate if there are constants 
Cl, • ‘ , Cfr not all 0, such that 

(1.7.1) Y. cjxXt) “ 0 

i 

With probability 1, for all i. Equation (1.7.1) is true if and only if 

(1.7.2) C/xXOl’) = 22 (^(0))ytc^c* = 0 

> y.fc 


that is if and only if the correlation matrix R{0) iB.singular. If a non-degenerate 
process is a direct product of factor processes, the latter are also non-degenerate. 
The only degenerate one-dimensional process is that of type Jkf(O). 
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2. The structure of degenerate and deterministic processes 

Theorem 2.1. Every degenerate t.h.G.M. process is the direct product of proc¬ 
esses of type Af(0) and (in some coses) of a non-degenerate t.h.G.M. process. 

In proving this theorem, it can be supposed that the original process has been 
replaced by an equivalent process, if necessary, so that the symmetric non¬ 
negative definite matrix i2(0) is in diagonal form, with only O’s and I’s down the 
main diagonal, say 0 to the vth place and 1 thereafter. Then Xj(t) = 0, when 
j ^ v and the process is obviously the direct product of v processes of type ^(O) 
and an (N — »')-dimensional non-degenerate process. 

Theorem 2.2. Let be the variables of a deterministic t.h.G.M. process, 

with correlation function R(t). 

(i) The process is the direct product of factor processes of types M(0), M(±l), 
M(e'‘) 

(ii) If the parameter t of the process is restricted to the integers, there is a non¬ 
singular matrix A such that 

(2.2.1) x(n) = A”i(0), 

(2.2.2) R(n) = 22(0)^*", n = 0, ±1, ±2, • • • 

(2.2.3) 22(0) = ^22(0)A*. 

The transition matrix A is the transform iSOB"* of an orthogonal matrix 0. If 
the process is non-degenerate, A is uniquely determined. 

(li') If the parameter of the process runs through all real numbers, there is a 
matrix Q such that 

(2.2.1') x{t) = e^’^x(0), 

— 00 < i < oo 

(2.2.2') 22(0 = «(0)e“' , 

(2.2.3') Q22(0) + 22(0)Q* = 0. 

The matrix Q is the transform of a skew symmetric matrix K. If the process 

is non-degenerate, Q is uniquely determined 

(hi) Conversely if 22(0) is any symmetric non-negative definite matrix, and 
if A(Q) IS any matrix satisfying (2,2,3) ((2.2 3')), where A is non-singular, there 
IS a deterministic t h.G M process.■unifi coirelaiion function given by (2.2.2) ((2.2.2')) 
and satisfying (2 2.1) ((2 2.1')), 

In proving (i) (ii) and (ii') it will be permissible to go to processes equivalent 
to the original one, if convenient. Moreover if the given process can be expressed 
as a direct product, it will be sufficient to prove (i) (ii) and (ii') for each factor. 
Since (i) (u) and (Li') are certainly true for processes of type M(0) (with A in 
(ii) the identity, and Q in (ii') the null matrix), and smce accordmg to Theorem 
2.1, processes of type M(0) can be factored out of the given process to leave a 
non-degenerate remaining factor, if any, it will be sufficient to prove (i) (ii) and 
(ii') for non-degenerate processes. 



242 


j. 1 .. noon 


Proof (< integral) of (i) and (ii) for yion-drgmvralr procmsPH. If the procip.s.s 
determined by {a;(n)j is determuiiHUc, (l.(i.l) is tiuc. Ileru'c 

(2.2.4) x^v 4- 1) = Axiv). 

Then (2,2.1) is true for n S 0, and will be established fetr all n tis .soon as it is 
shown that A is non-singular. U.stng (2.2.1), 

(2.2.5) R(n) = A’(a:(0)-a;(n)! = f?{x(0)•.4"j;(0) 1 = imA*", n a 0, 
and 

(2.2.6) R(.0) = .ei»(l)-x(l)l = ^l/lx(0)-.4x(0)l = ARtS))A*. 

Under the present hypotheses, R(Q) is non-singular, n^en A i.s determinerl 
uniquely by (2.2.5) with n = 1, and A cannot be singular becau.se of (2,2.6). 
There is an equivalent process in which R{0) is the identity, Con.Hidering this 
process, (2.2.6) become-s I = A A*, so that A is orthogonal. Finally there is an 
equivalent process (obtained by an orthogonal change of variables) in which 
R{0) is still the identity and the matrix A is in the (real) normal form of or¬ 
thogonal matrices; all the e.Iementa of A are 0 except for two-dimensional rotation 
matrices or I'a or — I’a down the main diagonal. It is now obvious that the 
process is the direct product of processes of types iVf(dcl), M(e‘'). 

Proof (I continuously varying) of (i) and (ii') for non-degenernlc processes. If 
the t.h.G.M. process determined by [i(0) is deterministic, (1.0.1) i.H true. 
Hence 

(2.2.5') R{t) = E[x{8)-zis -h 0) = R{0)A(l)* 

(2.2,60 R{0) = SH®(s + + 01 = A{l)R(0)A{l)*. 

The matrix A(t) is uniquely determined by (2.2,50 since R{Q) i.s non-singular. 
It then follows from (1,6.1) that 

(2.2.7) Ais + t) = A{s)A(t). 

The continuity hypothesis (1,3.1) becomes 

(2.2.8) lim K(0)il(0* = fl(0), 

(-*0 

which implies that 

(2.2.9) lim Aijl) - L 

It is well known that any solution of (2.2,7) and (2.2 9) can be written in the 
form ,4(0 = e*'’. If now the right side of (2.2,60 is expanded in powers of i 
and the coefficient of t is set equal to 0, the resulting equation is (2.2,30. It can 
be supposed, going to an equivalent process if necessary, that J?(0) is the identity. 
Then A(t)A{t)* = 7, Q -|- Q* = 0. An equivalent process can be chosen so 
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that 72(0) is still the identity, and so that Q is in the real canonical form of skew 
symmetric matrices; its elements vanish except for possible two rowed matrices 

down the main diagonal. It is now clear that the non-degenerate process is a 
direct product of factors of type ikf(e’*) corresponding to two rowed matrices 
just described, and factors of type M(l). 

Proof of (iii). If i2(0) and A(Q) satisfy the conditions of Theorem 1,2 (iii), 
choose x(0) as any Gaussian variable with correlation matrix i2(0). Then 
define x{n) by (2.2.1) ((2.2.1')). The resulting stochastic process is temporally 
homogeneous if and only if E{x(8)-a:(s t)\ depends only on t. The details of 

the calculation will be carried out for only for t integral. 

In the first place 

(2.2.10) E{x(n)-x(n + v)] = £{A"x(0)-A"+‘'x(0)} = A’'R{0)A*''+\ 

Now (2.2.3) can be developed further; 

(2.2.11) R{0) = Ai2(0)A* = A*I2(0)A*' = ■ • • 
so that (2.2.10) reduces to 

(2.2.12) E\x{n)-x{n + v)} = J2(0)A*'. 

The process is thus temporarally homogeneous, and obviously satisfies the other 
parts of the definition of a deterministic t.h.G.M. process. Theorem 2.2 is now 
completely proved. 

The restriction imposed on i2(0), A(Q) by (2.2,3) ((2,2,3')) is quite loose. 
Given i2(0), there is always an A(Q) satisfying (2.2.3) ((2.2.3')) for example the 
identity (null matrix). Given an A which is the transform of an orthogonal 
matrix (a Q which is the transform of a skew symmetric matrix) there is always 
a corresponding 12(0): In fact A (Q) can be assumed to be orthogonal (skew sym¬ 
metric) and the 12(0) can be taken as the identity. 

3. TJE1.G.M. processes with an integral valued parameter 

In this section, the parameter t will range through all the integers. The condi¬ 
tion (1.5.3) that a t.h.G. process be a tJh.G.M. process can be simplified in the 
integral parameter case. In fact it will be shown that it is sufficient if 

(3.1.1) E{ ■■■ , x{n - 1), x(n); x{n -f 1)} =i E{x(n)] ®(n + 1)), 


with probability 1. If (3.1.1) is true, 

(3.1.2) x(v -f- 1) = Ax(y) -|- »)(i') 


n = 0, ±1, • • • 
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where A is the transition matrix of the process and i)(i') tins mean 0 and is inde¬ 
pendent of • • , x{v — 1), x{v). It follows that 


(3.1.3) 


x{n) = + 1) 

-H • • • -1- i}{n — 1). 


The terms involving the n{j) are all independent of ■ ■ , x(m ~ 1), x{jn) 'fliis 
equation therefore implie-s that 

(3.1.4) • • • , x{m — 1), a;(wi); x:(rt)| = A" "iCm) = E[x{m)\ x(n)l, 

and (3.1.4) is precisely the condition tliat the process ha.s the Markoff property. 
The following lemma will be useful. 

Lemma 3.2. Let x',(xit • ■ •, Xs) he any Gaussian chance variable, mih f?(xl 
= 0. Then there is a uniquely determined symmetric novr-negative definite matrix, 
S, and a Gaussian chance variable y, sudi that 

(3.2.1) E\yy\ = I 
and 

(3.2.2) X = Sy, /S' = L’lx-x). 

If z = Sy, and if S is symmetric, then the second equation in (3.2,2) is cer¬ 
tainly true. It is easily seen, by examination of the charact<>riHtie, values and 
vectors of the matrix jE(z'i} that this matrix has a uniciue symmetric non¬ 
negative defimte square root S. Hence if there is an S satisfying (3.2.2), there 
can be only one. The chance variables Xi, • • • , xn can he written as linear 
combinations of N uncorrelated Gau8.sian chance variables , • • • , satisfying 
= I: 

(3.2.3) z = Ai 


If A is written in the polar form A — SU, where S is symmetric and non-nega¬ 
tive definite and U is orthogonal, (3.2.3) becomes 


(3.2.4) x = SU^= Sy 

where y = satisfies (3.2 1). 

It will be shown below that every t.h.G.M. process can be represented as the 
direct product of factors of certain types. The deterministic types have already 
been catalogued; Af(0), Af(=fc:l), M(e’*). The non-deterministic factor type 
(integral valued parameter) will now bo described. 

M. Let {»[(«■)! be a sequence of mutually independent iV-dimensional 
Gaussian chance variables with 0 means and a common distribution function. 
Let A be any iif-dimensional square matrix Define x(n) by 


x{n) = X A”7;(n — m) 


inwO 


(3.3.1) 
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•where it la supposed that^^ A is so chosen that the series converges with prob¬ 
ability 1, This will be true, for example, if all the characteristic values of A 
have modulus less than 1, so that the terms of go exponentially to 0 It 
will be shown below that it is no restriction to assume that A has this character. 
The variables {x(n)) determine a th.G.M. process. Since x(n)-Ax{n — 1) 
is independent of • ■ ■ , x(n — 2), xin — 1), the x{n) process is a Markoff process 
with transition matrix A: 

(3.3 2) E{ ■ ■ ■ , x(n — 1); x(n)} = Ax{n — 1). 

A process defined in this way will be called a process of type M A non-singular 
change of variables y(n) = Bxin) leads to a process of the same type: 

(3.3.3) y(n) = £ (5A5"*)’"5»,(n - m). 

It will sometimes be^ convenient to write a process of type M in a form slightly 
different from (3.3.1). Using Lemma 3.2 it is evident that there are Gaussian 
variables (f(a)) satisfying 

(3.3.4) = 0, E[^{m) f(»)) = S„,J, m, n = 0, ±1, ■ , 

and a symmetric non-negative definite matrix S such that rj(n) = <Sf(n). Then 
= E{^Cn).^(n)} and 

(3.3.5) x(n) = f) A’"EHn - m). 

rru-O 

Under the change of variable y(n) = Bx(n), A becomes BAB~‘^ and becomes 
BS'^B* 

The only condition on A required for convergence in (3.3.6) is that A”*? — 1 0. 
It will now be shown that A can always be assumed to have only characteristic 
values of modulus less than 1, in the .Sense that there is an A -with this property, 
and satisfying the equations 

(3.3 6) m=l, 2, 

It is no restriction, going to an equivalent process if necessary, to assume that 
the elements of A vanish except for those in two square submatrices down the 
mam diagonal, where one submatrix Ai has only characteristic values of modulus 
less than 1 and the other, Ai, of modulus greater than or equal to 1. If the 
matrix S is written in terms of the corresponding submatrices; 

- (0 i) « - (I &) 

“ Throughout this paper, if A is any matrix, A'> is defined as the identity matrix I. 

'We shall use repeatedly KolmogorolT'a theorem that an infinite aeries of mutually inde¬ 
pendent chance variables with zero means converges with probability 1 if the series of their 
dispersion is convergent. (Kolmogoroff only states the theorem in one dimension, but the 
extension to n dimension is trivial.) If a series of mutually independent Gaussian variables 
converges, the senes of dispersions converges to the dispersion of the sum. 



246 


J. L. DOOB 


the condition on A irapliea that —>■ 0. If it ia ahown that <S’j == 0, it will 

follow that St = Si = 0, becauae *Si is symmetric and non-negative clefmiri? The 
matrix X will then be defined by 


(3.3.8) 



and A will satisfy (3.3.6) and will have only characteristic value.s of modulus 
less than 1. The problem has thus been rcducetl to the ease where rii is absent; 
A only has charactcnstic values of modulus at least 1, and it must be proved 
that j 4"(S 0 implies that 5 = 0. The proof of this is immediate when A is put 

into its Jordan canonical form. 

The symmetric non-negative definite matrix S satisfies the equations 
(3.3.9) ft(0) = £ A”^ A*” = 5* -b riii(0)A*. 


Theorem 3,4 A direct product of processes of type M is oho of type M. Con¬ 
versely any factor process of a process of type M is itself of type M. 

The direct part of the theorem is obvious. To prove the convciRC, suppose 
an /^-dimensional process of type M has an f-dimensional factor, corresponding 
to the variables a:i(n), • • • , Xt{n). It can be supposed, that all factors of type 
Af(0) are separated out, so that there are indices j, h. I ^ j ^ I ^ k < N such 
that the {xv(n), ••• , xX^)! “-twi {^fc+iWi » *s(b)] proccftscs are non-de¬ 
generate and that the variables x y+i(u), • ■ • , xjt(n) vanish identically. Making 
a change of variables, if necessary, it can be supposed that i?(0) has the form 


(3.4.1) 



fc-j 

0 

0 

0 



and that R{n) has the blocks of zeros indicated in (3.4,1). Since i2(l) = i/(0)A*, 
A must have the form 


(3.4.2) 




Then A" will have this same form. Finally, because of (3.3.9), »S*, and therefore 
S must have the form 


/- 0 0 \ 

(3.4.3) 5’; 0 0 0 . 

\0 0 -/ 

Let rio be the matrix whose elements are the same as those of A except that the 
(j -f l)th to fcth columns of Ao vanish. Since 

(3.4.4) A7S = A”8, m = 0, 1, • • • 
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it follows that 


(3 4.5) 


00 

x{n) = ^ .AS'iSfCn — m). 


It is now obvious that the (a:i(n), • • - , a;i(n)} process is of type M. 

Theorem 3.5 A non-degenemie process of type M has no deterministic factors. 
Any factor process is non-degenerate and of type M To prove the theorem, 
it will therefore be sufficient to prove that the process itself cannot be deter¬ 
ministic. If it were, we should have 

x{n) — Ax{n — 1) = S^in — 1) = 0. 


Then S = 0. But then the process is certainly degenerate, contrary to hy¬ 
pothesis. 

Theorem 3 6. (i) Every t h.G.M. process {discrete parameter) is the direct 
product of processes of type M(0), M(±l), M{e'*), M. 

(ii) Let A be a transition matrix of a t h.G.M. process, with varieties {a5(n)). 
There are mutually independent Gaussian variables • ■ , f(0), f(l), • ■ ■ , f satis¬ 
fying 


(3.6.1) 


£(f(n)} = 0 

i^{«(n)-^(n)} = = /, 


and symmetric non-negative definite matrices S, T such that 

og 

(3.6 2) x{n) = Z A”S^{n - m) -f A" TJ, n = 0, 1, • • , 
(3.6.3) = AT^A*, 

(3 6 4) 12(0) = E A”'S''A*’” -[- = AR(0)A* -f- S\ 

m—Q 


where the senes in (3 6 2) converges with probability 1. If A is non-singular, (3.6.2) 
holds for all n. The sum and last term in (3 6 2) are linear transformations of x{n): 
(3 6 2) exhibits in part the decomposition into factor processes described in (i). The 
correlation function is given by 


(3.6.5) 


R{n) = i2(0)A*" 

n = 0, 1, • • • . 

R{-n) = A"K(0). 


(lii) The transition matrix A is uniquely determined if and only if the process 
IS non-degenerate. In any case, there is a transition matrix whose characteristic 
values are all of modulus less than or equal to 1, and whose characteristic values of 
modulus 1 correspond to simple elementary divisors. The transition matrix A 
furnishes the solution of the prediction problem of the process: 


(3.6.6) E[ ■ • , x{m — 1), x{m)-, x{m -t- n)) = A^x{m) 


n = 0, 1, • • • . 
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The matrix S^, which is uniquely determined, measures the disprrsim of x{n + 1) 
about Us predicted value in terms of x(n): 

(3.6.7) E{[x{n + 1) — Ai(n)]*l = S\ 

(iv) Conversely if A is a matrix with at least one charactenslir. value, of modulus 
less than 1 or of modulus 1 and corresponding to a simple elementary dimsor, A is the 
transition matrix of a t h.G.M, process, with /i(0) not the null matrix. If all the 
characteristic values of A are as just described, A is the transition matrix of a non- 
degenerate t.h.G.M. process. If 11(0), A are matrices satisfying (3.6.4) with 
22(0), S, symmetric and non-negcUive definite, there is a t.h.G.M. process whose 
variables can be written in the form (3.6.2) with the given 22(0), S, A. 

This decomposition oi a t.h.G.M. process into det.erminifitic factors can be 
considered aa a special case of the general decomposition theorem of Wold, wliich 
is applicable to all t.h.G. process.” (Wold only considered the one-dimensional 
case.) The proof in the present special case is .simpler, however, and illumi¬ 
nates the general case. 

Proof of (i) and (ii). Plquations (1,5,3) and (1,6.4), in the present case, 
lead to 

(3.6.8) , a:(n - 1), x{n)', x{n + 1)) = E\x{n)] x{n -|- 1)) = Ax{n). 

The first two terms are equal because the process has the Markoff property. 
The last term is linear in x(n) because the process is Gaussian. The matrix A 
can be taken independent of n because the process is temi)orally homogeneous. 
Thus (3.6.8) involves the three fundamental properties of the x(n) process. 
From the definition of conditional expectation, it follows that x(n -f 1) — Ax(n) 
is independent of the chance variables • • • , x(n — 1), x(n). Hence the variables 

■ ■ ■ , [i(n) - Ax(n - 1)], lx(n + 1) - Aa:(n)], • • • 

are mutually independent. According to Lemma 3.2, there are mutually inde¬ 
pendent chance variables ({(n)) satisfying 

(3.6.9) x(n) - Ax(n - 1) = SHn), El^(n)-((n)} = I, El^(n)} = 0, 

where S is symmetric, non-negative definite, and satisfies (3.6.7). The matrix 
thus measures the dispersion of x(n) about its predicted value Ax(n — 1). 

The representation (3.6 2) can be obtained very simply. In fact 

x(n) = [a;(n) — Ax(n — 1)] -f- A[a:(n — 1) — Ax(n — 2)] -f * ■ • 

(3.6.10) + + A"-'x(v) 

- "E A'<Sf(n~j) d- 

“ A Study in the AnalysU of Stationery Time Senes, Uppsala (1938), p. 89- See also 
Kolmogoroff, Bull. Acad. Sci. URSS Ser. Math., Vol. 6 (1941), pp. 3-14 and Bolletin Mo$- 
kovskogo Qosudarstvenogo, Malhematika, Vol. 2 (1941), pp. 1-40), in whose papers the de¬ 
composition theorem is brought out in its full significance. 
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and it will be shown that when v -7> — oo (3.6.10) leads to (3.6.2). Before going 
to the limit, however, we note that in (3.6.10) the sum is independent of the 
variables • • • , x{v —1), x{v), so that 

(3.6.11) E[ • ■ ■ , x(>' —1), x(v)', a;(n)} = d."~'x(v) 
which is another way of writing (3.6 6). Moreover, using (3.6.11), 

(3.6.12) Bin - p) = E[x{v)-x(n)] = /i:(0)d*"-', 

which is another way of writing (3 6.5). (The value of R(n) for n < 0 is ,ob- 
teined using the fact that J2(—n) = The last term in (3.6.10) is the 

conditional expectation of xin) for preassigned • • • , x{v —1), x(v). It follows 
from the corollary to Theorem 1.2 that this conditional expectation converges 
with probability 1 when r — oo, but this convergence will be proved directly 
in the present particular case. 

From (3.6.10), 

(3.6.13) E{x(n)-xin)] = R(Q) = "e' + d’'“'li:(0)d*"“'. 

J-O 

The terms of the sum and the last term are all symmetric and non-negative 
definite matrices. It follows that there is convergence in (3.6.13) when v —» 

— oo: 

(3.6.14) 22(0) = f) A‘^A*^ + lim d"22(0)A*". 

j—0 wi-^oe 

The convergence of the series of dispersions in (3.6.14) implies that the senes of 
chance variables in (3.6.2) converges, with probability 1. Then when v — oa 
(3.6.10) becomes 

(3.6.15) x{n) = X A^S^(n — j) + z(n), 

,-Q 

where 

(3.6.16) z(n) = lim A''~''x{v). 

I*-*—QO 

Since x(n) is independent of f(n -f- 1), |(n + 2), • • , z(n) is independent of every 
{(m). Moreover, writing 2(0) = T^, where f satisfies (3.6.1) and T is symmetric 
and non-negative definite, 

(3.6.17) z(n) = A"z(0) = A"rf, n S 0. 

Thus (3.6.3) and (3.6.4) are satisfied. If A is non-singular, (3.6.17) will be cor¬ 
rect for negative n also. 

The decomposition of the process into factor processes of the types described 
in the theorem will be obtained by a detailed analysis of the significance of 
(3.6.2). Under the change of variable 2 /(«) = Bx(n), becomes and 
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A becomes BAB \ Making a suitable change of variables, if neeeasary, it can 
be supposed that A has the form 


(3.6.18) 



where the characteristic values of A\ have morJuli une<iual to 1 and those of A^ 
have modulus 1. The matrix can be written in term.s of subruatrice.s of the 
same dimensions in a corresponding way: 


(3.6.19) 



where Ti, Ti are symmetric and non-negative definite. A further change of 
variables may be made, if necessary (transforming only the last n variable.8) pre¬ 
serving the forms (3.6.18) and (3.6.19) and transforming Ta into the identity. 
Then using (3.6.3) 

(3,6.20) A.TlAt = Tl, AiA? = L 

Hence Ai is orthogonal. Developing (3.6,20) further, = T], for all 

m ^ 0. When m -+ <» in this equation, the terms in the matrix product on the 
left involve the with power of the characteristic values of Av (all of modulus 
different from 1, by hypothesis). Then those charac,teristic values whicli actually 
appear can only be those of modulus less than 1, and the matrix on the left must 
go to 0 as m 00 : Tl a 0, Since T is non-negative doftnite, T must have the 
simple form 


(3.6.21) T: 

The matrix 5 can also be divided into corresponding Hubmatriees; 


(3.6 22) 



The convergence of the series in (3.6.4) implies that 

lira ATfilA?” = 0. 


Since Aa is orthogonal, this means that jSj = 0, and since S is symmetric and non¬ 
negative definite, iS has the form 

(3.6.23) S:(*' 2). 

It is now clear from (3.6.2) that the x(n) process is the direct product of a process 
of type M and a deterministic process corresponding to the division of the vari¬ 
ables determining the above submatrices. The deterministic factor process is 
the direct product of the elementary types already discussed. The variable 
ii(n) and the sum in (3.6.2) are linear transformations of x(n). 
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Proof of {in). If the process is non-degenerate, R{Q) is non-singular, and the 
transition matrix is determined uniquely by (3.6.5) with n = 1 , If the process 
is degenerate, there will be one or more factor processes of type M(0), and their 
transition matrices are quite unrestricted. In the non-degenerate case the 
characteristic values will be of modulus less than 1 (corresponding to a factor of 
type M, if one is present), or equal to 1 (corresponding to the factors of type M 
(±1), M{e'^) making up the determimstic factor, if one is present), and in the 
latter case the elementary divisors are simple. If the process is degenerate, and 
if the part of A corresponding to the factors of type M (0) is taken to be the iden¬ 
tity, there will be simple elementary divisors corresponding to the characteristic 
value 1 for each such factor. The remaining statements of (iii) have already 
been proved. 

Proof of (iv). Let A be a matrix with at least one characteristic value of 
modulus less than 1 or equal to 1 and corresponding to a simple elementary 
divisor. Then some transform BAB~^ has the form 


Ml 0 o\ 

(3,6.24) ( 0 Ai 0 I 

\o 0 aJ 


where Ai (if present) has only characteristic values of modulus less than 1, At 
(if present) is orthogonal, and both Ai, At are not absent. For the purposes 
of the present proof it can be supposed that A is already in this form. Define 
S, Tby 

/Si 0 0\ /O 0 0\ 

(3.6.25) 5: ( 0 0 0) T: (0 / 0 

\0 0 0 / \0 0 0 / 

where the indicated aubmatrices of S and T are in the same positions as those of 
A, and where is any symmetric positive definite (and therefore non-singular) 
matnx of the proper dimension. The series in (3.6.4) converges and the first 
equation in (3.6.4) defines a matrix i2(0) which obviously satisfies the continued 
equality. If all the characteristic values of A are as described in the beginning 
of this paragraph, A 3 can be supposed absent. In this case 


K(0) = + r* + • • • 


is non-singular. The proof of the first two parts of (iv) has now been reduced 
to that of the last part. Suppose then that jB(0), A, S satisfy the hypotheses 
of the last part of (iv). Then 

12(0) = Ai2(0)A* -I- S" 

(3.6.26) AR{0)A* = A^R{0)A*^ + AS^A* 


A"“'i2(0)A*""‘ = A'‘i2(0)A*'‘ -f- A"~'S“A*"~'. 
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Adding tliese equations 

(3.6.27) fi(0) + A"/2(0)A*". 

This equation leads to (3.6.14), and T^, defined as the limit in (3.6.14), satisfies 

(3.6.3). Let • ■ • , ^(-1), {(0)) * * • , f be mutually independent Gaussian vari¬ 
ables satisfying (3.6.1). Then the a:(n) defined by (3.6.2) determine the vari¬ 
ables of a Gaussian process with non-negative values of n, hut a slight modificar 
tion is needed to obtain an expression defined for all n To obtain this, it can 
be supposed that A, T, S are in the forms (3.6.24), (3.6.25). Define K by 

(I 0 0\ 

(3.6.28) I; 0 At 0 . 

\0 0 j/ 

Then A is orthogonal and AT ~ AT, If now (3.6.2) is used to define x{n) for 
all n with A^T replaced by A^T, the a:(n) process is a t.h.G.M. proce.s8 with the 
desired properties. 

The properties of the process reversed in time are of some interest. It is easy 
to see that if n is replaced by —n, a t.h.G.M. process remains a t.h.G.M. process. 
If the original process is non-degenerate, the new transition matrix is 
/2(0)A*ZJ(0)“\ If the transition matrix remains unchanged when n is replaced 
by —n, i2(0)A*i?(0)~‘ = A. This is equivalent to the equation R{n) = R{~n). 

The simplest generalization of a t.h.G.M, process is the following, Ijct the 
chance variables iy(n)) determine a t.h.G. process with the property that for 
some iV > 0, 

(3.7.1) E{ ■■■ ,y{n- 1); j/(7i)) = E[y{n ~ N), ,y{n ~ 1); y{n)\, 

vdth probability 1. If iV = 1, the process is a t.h.G.M. process. This type 
process will be called a t.h G.Mw. process. To avoid notational complications 
only the one-dimensional case will be considered. The right hand side of (3.7.1) 
is a linear combination of the variables y{n — N), ■ • - , y(n — 1). The variables 
thus satisfy a difference equation of the form 

(3.7.2) y{n) - aiy{n - 1) - ... - aMy{n - A) = ij(n) 

generalizing (3.6.9), where yin) is independent of the chance variables ••• , 
yin — 2), y(n — 1). The l7j(n)} are mutually independent chance variables 
with zero means and dispersions independent of n. Equation (3.7.2) leads to 

(3.7.3) yin) - a{"~’"V(ffi -1)- as^’'~”^yim - iV) =• y,^”-'”\'n) 

(m g rv) 

where ^'"“"''(n) has zero mean and is independent of the chance variables • • - , 
yim — 2), yim — 1). Hence 

(3.7.4) B[ • ■ • , y{m - 1); y(n)) = E[yim - iV), • • • , yim - 1); y(n)), 

rh ^ n„ 
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The difference equation (3.7.2) has been studied in some detail in the past.” 
We shall use an approach which adds insight into the structure of the solution 
and which clarifies the place of the solution in the general theory of t.h.G. 
processes. This approach is in terms of JV-dimensional t.h.G.M. processes. 
Define the variables (a:(n)} of an iV-dimensional process by 


(3.7.5) Xi{n) = y{n -f j), n = 0, ±1, • • ■ , j = 1, • • • , AT. 


The xin) process is evidently a t.h.G.M. process. If the index W of the y{n) 
process is the minimum for which (3.7.1) is true, the corresponding x{n) process 
will be npn-degenerate. Then the transition matrix A is uniquely determined, 
and is evidently 


(3.7.6) 


/o 

1 

0 . 

. . 0\ 

: r 

0 

1 0 

: : M 

\ 0 


• 

-oil 



- 

• Oi/ 


Oi 9 ^ 0. 


The matrix S, measuring the dispersion of the prediction Ax{n — 1) of x(n), 
has the form 


(3.7,7) 



The characteristic equation of A is simply 

(3.7.8) a’' - Oiot""' - • • • - = 0. 

The matrix A has only a single characteristic vector corresponding to each char¬ 
acteristic value A, the vector (1, X, • ■ • , Hence if X is a multiple root of 

(3.7.8) , it does not correspond to a simple elementary divisor. Therefore, ac¬ 
cording to Theorem 3.6, all roots of (3 7.8) of modulus 1 must be simple roots. 
It will be proved below that either no roots have modulus 1 or all roots have 
modulus 1, 

If an AMimensional non-degenerate t.h.G.M. process is given whose transition 
matrix A and dispersion matrix 3 have the forms (3.7.6) and (3.7.7) respectively, 

Xj(n) — Xj+i(n — 1 ) = 0 

with probability 1, for j < N. Then a y{n) process can be defined unambigu¬ 
ously by (3.7.5). Since for fixed j, x,(n) deterimnes a one-dimensional t.h.G. 
process, the y{n) process is a t.h.G. process, and (3.7.1) is obviously true, with 
N minimal if A is non-singular. 

Case 1. 3 = 0 (deterministic case). In this case the x(n) process is deter¬ 

ministic, and the y(n) process satisfies the equation 

(3.7.2') y(n) = aiy(n — 1) + ■•■ + ar/Vin - N). 


I* Cf. for example H. Wold, A Study in the Analysts Of Stationery Time Series, Uppsala, 
1938. 
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All the roots of (3.7 8) are simple roots, of modulus 1. Hince S = 0, 

(3.7.9) x(7i) = n = 0, ±1, • • ■ 


and therefore 

(3.7.10) yin) = Xiin — 1) = $3 (^" Ji *= 0, drl ••• . 


Using either the well known form of the .solution of the A^th order difference 
equation (3.7.2') or of the powers of an orthogonal matrix, it follows that 

ft 

(3.7.11) yin) •= 2 ivj cos + f/ shi ndj) 


where the tj,- and are (one-dimensional) Gauasian variables, and 

(cos fly -f i sin Sy] 


are the N distinct characteristic values of A, that is the roots of (3.7.8). 

Case 2. 5 0 inon-deteministic case). In this case it will now he shown that 

the x(n) process can have no deterministic factors; that is that the roots of 
(3,7.8) all have modulus less than 1. In fact let d be a root of (3.7.8), corre¬ 
sponding to the characteristic vector z of A*'. 


(3.7.12) 


(a^d*^ *1 ^ 4" \ > Oat 4* -)-*'• + Oifi’* ^) 


Then using (3.6.4), 

(fl(O)z, z) = (AB(0)A*z, z) + (S*z, z) 


(3.7.13) = (fi;(0)A*z, A*z) + iSz, Sz) 

= idr(f2(o)2,«) + s'ii3r. 

Hence (/31 cannot be 1, and the x(n) process can have no deterministic factors 
[Equation (3.6.2) becomes 


(3.7.14) 1(71) - i; A''S^in - m) 

which leads to 

(3.7.16) vin) - S £ (A"’5)iy{y(n - m - 1) - « £ (A"')vf{;,(n - m - 1). 

y_i m-o n..D 

According to Theorem 3.6 the only restriction on the coefficients Oi, * • ■ , 
in the two cases S = 0, jS 0, are respectively that equation (3.7.8) has N 
distinct roots of modulus 1 and all roots of modulus less than 1. Hence (3.7,10) 
and (3.7.15) furnish (with the stated restrictions on A) the most general 
t.h,G.Mx. processes. 
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It was shown in Theorem 3,6 that if R{n) is the correlation function of a 
thG.M. process, R{n) can be expressed in the form (3 6.5), where A is some 
suitably chosen matrix. Conversely if the correlation function of a t.h.Q. 
process has the form (3.6 5), the process is a t.h.G.M. process since x{n + 1) — 
Ax(n) is then orthogonal to (and therefore independent of) the variables 
• ■ • , x(n — 1), x(n). (This fact implies the truth of (3.1,1)). The character¬ 
ization of t.h.G.M. processes in terms of their correlation functions is thus 
easily solved. The following theorems characterize one-dimensional t.h.G.My. 
processes from various points of view. It will be convenient, and also intrin¬ 
sically interesting to treat at the same time a slightly larger class of processes; 
the class of am'poneni processes of t.h.GM. processes. A one-dimensional t.h.G. 
process with variables {xi(n)) will be called a component process of an A-dimen- 
sional t h.G.M. process if there are N — 1 t.h.G. processes with variables 
(x 2 (n)), , jxy(n)} such that the .N^-dimensional process with variables 

[xi(n), • ■ ,xy(n)} is a t.h.G.M. process. If the variables {x(n)} determine 
an iV-dimensional t.h.G.M. process, the t.h.G. processes determined by 
(®i(?i)}, ••• , [xff(n)} will be called its N component processes. If an x{n) 
process is not of type M(0) and is a component process of an A-dimensional 
t h G M. process, it is a component process of a non-degenerate iVi-dimensional 
t.h.G.M. process, for some iVi S N. It has already been seen that one-dimen- 
sional t.h.G.My. processes are component processes of iV-dimensional t.h.G.M. 
processes. 

Theorem 3 8. Let • • • , x(0), x(l), ••• be the variables of a one-dimensional 
t h.G process. The process %s a component process of an N-dimensional t.h.G.M. 
process if and only if the chance variables 

(3.8.1) x(0), S{ ■ • • ,x(-l), x(0); x(n)), » = 1, 2, ■ • • 

are linearly dependent on the first N. 

Suppose that the s(n) process is a component process of an .A^-dimensional 
y(n) process: x{n) = yi{n), with correlation function Ry{n) and transition matrix 
A. Since A satisfies its characteristic equation 

(3.8 2) det 1 aJ - A I = - ■ ■ ■ - tty = 0, 

it follows from (3.6 2) that il pin + N) is defined by 

(3 8.3) y(ji + N) — aiy{n + N — 1) — — ayy(n) = ^(n -H N) 

then rj(n -f N) is independent of • - ■ , y(n — 1), y(n). Then 

(3.8.4) x(n + N) ~ aix(n -b iV — 1) — • • — ayx(n) = vi(n + N) 

where T]i(n + N) is independent of the chance variables ■ ■ ■ , x(n — 1), xi,Ti). 
Equation (3.8.4) leads to 

(3.8.5) x(n + N+ v) - oi^’x(7i M - 1) 
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where tji'' (n + iV + v) has zero mean and is indepe.ndent of the chance variables 
• ■ ■ , a:(n - 1), x(n). If the operator 

fi( - ■ • , x(ti - 1), x(n); • 1 

is applied to this equation, the result is 

■ ,x(n - 1), x(n); x(n + Af + r) | 

(3.8.6) A , . 

- £ oi'’ jS{ • • ■ , x(n - 1), .r(n); x(7i + /V ~ ?n)| =. 0, 

The last term in the sum is x(n) and (3.8.6) is thus the de.sired linear relation. 

Conversely suppose that the (N + l)th chance variable in (3.8.1) is linearly 
dependent on the first N: 

El'- - ,x(n- 1), x(n);x(n + Af)i 

(3.8.7) 

ZS • • ,a:(n - l)x(n);x(n + A'’ - m)), n = 0, ±1, ■ • •. 

Define the variables yi(n), , yy(n) of an A'-dimensional t.h.G. process by 
j/i(n) = x(n) 

(3.8.8) , x(n - 1), i(n); x(n + 1) . 
yw(n) =£!{•••, x(n - 1), x(n);x(n + .V - 1). 

Then 


E('" ,y(n - 1), y(n);yi(n + 1)) = yj(n) 


(3.8.9) i/(n - 1), y(n); yn-iin + 1)) = y^{n) 

Bl'-',y{n - 1 ), y{n)-,yfr{n +.!)) 

= E[--- ,x(n - 1), x(n); x(n + Af) 1 =. X) aml/ir+i-«(n). 


The y{n) process is therefore a t.h.G.M. process, with transition matrix (3.7.6), 
and the x(n) process is a component process. 

The following particular type of t.h.G. process will be involved in the proof 
of Theorem 3.9. If the chance variables {»i(ti)) determine a t.h.G. process 
whose correlation function /2,(n) vanishes when n ^ iV, then according to 
(1.3.6) the complex spectral function G,(X) of the ti(n) process is continuous, 
\vifh derivative G!j(X) given by 


g;(\) 


2ir 


1 

L 






<3.9.1) 
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It IS easily verified (using the fact that i2,(n) = i2,(—a) = i2,(n)) that if a is a 
root of the equation 

(3.9.2) E = 0, 

n—(«-U 

then a, l/a, l/s are also roots, of the same multiplicity. Moreover if | a | = 
1, a is a root of even multiplicity, since the sum in (3.9.2) is real and non-negative 
when I z I = 1. When | z | = 1, 

(3.9.3) 1 a I I (z — a)(z — 1/a) | = | z — a |^. 

Hence i7((X) can be written in the following simple form: 

(3.9.4) G-(X) = I -f • • ■ + l>v-i T 

where the roots of the indicated polynomial have modulus at most 1, and the 
coefficients are real. 

Theohem 3.9. Let ■ ■ ■ , a:(0), a:(l), •••he the variables of a one-dimensional 
t.h.G. process The process ts a component process of a finite-dimensional t h.GM. 
process if and only if the complex spectral function is the sum of the integral of 
the square of the absolute value of a rational function of with real coefficients, 
and of a monotone non-decreasing function increasitlg only in a finite number of 
jumps Specifically. 

(i) The process is a component process of an N-dimensional t.h.G.M. process 
if and only if the complex spectral function has the form 


(3.9.5) 



+ • • • + div-i r 

I aoe*'''^ -f • • • + ooir r 


dX + S(X) 


where 

(a) Q(}i) IS a monotone non-decreasing function satisfying (1.3.3), increasing 
only by jumps, at no more than N points; 

(b) the denominator of the integrand vanishes at every discontinuity of G{\), 
and the numerator vanishes at every zero of the denominator, to at least the 
same order; 

(c) the coefficients oo, • • • , ajv, do, • • • > dw-i are real, oo ^ 0, O' unless 
the integrand vanishes identically, and the roots of the polynomials in the 
integrand have modulus, less than or equal to 1. 

The integral vanishes identically if and only if the x{n) process is a component process 
of an N-dimenmonal deterministic process, and &(X) vanishes identically if and only 
if the variables x{n) vanish identically or the x{n) process is a component process of 
an N-dimensional t.h G.M. process with no deterministic factor. 

(ii) The process is a t.h G.M y. process {deterministic case) if and only if the 


It is easily seen that the first term of the two can also be described simply as the in¬ 
tegral of a rational function of which is non-negative for X real and is an even function 
of X like all complex spectral density functions^ 
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amvpUx spectral function. G(\) = 6(X) ts a monotone non-dtcreanng Junction satis¬ 
fying (1.3.3) increasing only in jumps, at no more than N points; {non-dctenninislic 
case) if and only if the complex spectral Junction has the form 


(3.9.6) 



r 


where oq , ■ ■ ■ , an are real and oca ^ 0. 

Proof of {i). If the a:(n) proceea is a one-dimenHional coinporiijnt of an N- 
dimensional t.h.G.M, proccae, it has already been ween that for properly choaen 
real numbers ai, ■ • ■ , Ck , (3.8.4) is true, where ruin + N) is independent of 
the chance variables ■ ■ •, x{n — 1), x(n). Ec[uation (3.8.2) can he assumed to 
have all its roots of modulus less than or equal to 1. It follows from (3.8.4) 
that iii,(n) is independent of tii(m) if J a — m 1 ^ hf. The complex spectral 
function of the r}i{n) process is therefore continuous, with derivative given by 
(3.9.4). It will be no restriction to assume that lio 0 unless the derivative 
vanishes identically. According to (1.3.6), if (r(X) is the complex spectral func¬ 
tion of the x(n) process, 


(3.9.7) 


EM0)vy{n) 1 = £ 1 + •«• T dh 


[' I e*' 


^ aie 


ay |“d(?(\). 


Hence if &(\) is the jump function of G(\) (5(—tt) = 0, and Q'(X) is constant 
except for jumps at the same points as those of (r(X), and of the same magnitude), 

1 bae^^" • • • -f- by^i j* dX 

= I - ayf d[G{\) - (5(X)] 

r ^ 


(3.9.8) 


+ 1. 




fly 


‘d^(X). 


Since the first two integrals are continuous in X, the last must be continuous also. 
Hence the last integrand must vanish at every discontinuity of &(X), that is at 
every discontinuity of (t(X), and the last integral vanishes identically. It 
follows that 


(3.9.9) 


G(X) - 5(X) = 


1 baP^’^ ... -j- I* ^ 

I -TTyX- a\ 

J~w e — ... _ (j„ 


where the numerator vanishes at each aero of the denominator, with the same or 
greater multiplicity, Since the denominator vanishes at each discontinuity 
of G(X), there can be at most N discontinuities. If the A'-dimensional process 
is a deterministic process, it can be assumed that all the roots of equation (3.8.2) 






GAUSSIAN PROCESSES 


269 


have modulus 1, that is that the denominator and hence also the numerator in 

(3.9.9) have N roots. This can be true only if the numerator vanishes identi¬ 
cally: G{\) = fi'(X). If the iV'-dimensional process has no deterministic factor, it 
can be assumed that all the roots of equation (3 8.2) have modulus less than 1. 
Then G(X) can have no discontinuities: Q(\) = 0. 

Conversely if G(X) has the form described in Theorem 3.9 (i), 0(\) can be 
assumed in the form (3 9.9) with real coefficients in numerator and denominator 
and the stated relations between the jumps of G(\) and the zeros of the numerator 
and denominator in the integrand. (If the integrand vanishes identically and 
if G(X) has N discontinuities, aj, • • , can be chosen as those numbers making 
the polynomial 


e 




a\e 


t(JV-l)X 


CLff 


vanish at the discontinuities of G{\).) Then 

R{n N) — aiR(n + N — 1) — — aNR{n) 

_ ix(n+i) [l>o 4- • • ■ + ... 

(3.9.10) 1 - - ... - 

-fl^]d^(X). 

The last integral vanishes since the bracket vamshes at every jump of S(X). 
The denominator in the first integrand is the value on | z j = 1 of a polynomial 
all of whose roots are outside | z [ = 1, or on [ z [ = 1. Any zero on | z | = 1 
corresponds to one of the numerator at the same point. The integral therefore 
vanishes if n S 0 (Cauchy Integral Theorem): 

(3.9.11) R{n + N) — aiR(n + — 1) — ••• — ayR{n) =^0, n § 0. 

This equation implies that 

(3.9.12) x(n + N) — aix{n -f AT — 1) — • • • — o«^z(n) 

is independent of the chance variables ■ • , x(n — 1), x{n), that is that (3.8.4) 
is true, where T;i(n + N) has the stated properties. It has already been seen 
in the proof of Theorem 3.8 that this implies (3.8.6) and that this in turn implies 
that the process is a component process of an iV-dimensional t.h.G.M. process 
whose transition matrix A has characteristic equation (3.8.2). In particular if 
(r(X) = ^(X), the roots of the characteristic equation are of modulus 1, so that 
the iV-dimensional process must be deterministic. If &{\) s 0, the x(n) process 
is a component process of an JV-dimensional process whose transition matrix A 
has only characteristic values of modulus less than 1. This AT-dimensional 
process can have no deterministic factors other than one or more of type iW’(O). 
If these exist, (and if the x(n) process is not of type Af(0)) they can be replaced 
by non-degenerate factors of type M, to obtain an iV-dimensional process with 
no determmistic factor, having the x(n) process as a component process. 
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Proof of in). If the a:(n) process iH a process, (3.8.4) is true with 

tiiifn) independent of if m j>s n. The discussion in (i) is therefore simplified 
by the fact that the numerator in. (3.9 9) is constant. If this constant is 0, 
the spectral function is a function of jumps: G(X) ^(X). If this constant is 
not 0, the denominator in (3.9.9) does not vanish, and 5'(X) therefore vanishes 
identically. The converse is proved as in (i), 

Theorem 3.10. (i) J/ ai, • • • , an are real numbers, there rs o one-dimentriorud 
t.h.G. process not of type MiO) v>ith correlation function Bin) satisfying 

(3.10.1) Bin + N)- a,Bin + iV - 1) - • • ■ - a^Bin) « 0 
for n ^ 0 if and only if the equation 

(3.10.2) a" - _ ... _ av = 0 

has at least one root of modulus less than or equal to 1. 

Let , x(0), i(l), ■ ■ • be the variables of a one-dimensional t.h.G. process 
not of type Af(0). 

(ii) This process ta a component process of an N-dimensiorwl t.h.G.M. process if 
and only if the correlation function Bin) satisfies an Nth order linear difference 
equation (3,10.1) for n ^ 0. 

(iii) The process is a t.h.G.Ms, process if and only if the difference equation 
(3.10.1) IS true for n —iN ~ 1). In this cose the vectors (x(n), ••• , 
x(n + N — 1)1 determine an N~dimensional i.h.G.M. process. 

(iv) Equation (3.10.1) ts satisfied /or n ^ ~N if and only if 

(3.10.3) x(n + N) — Uixin N — 1) — ~ ayzin) *= 0, n = 0, ±1, • • • . 

Proof of iii), iiii), iiv). Ijet the x(7i) process be a component process of an 
iV-dimensional t.h.G.M. yin) process with correlation function *(’’■) == 

yiin), and transition matrix A. Since A satisfies its characteristic equation 
(3.8.2), it follows from (3.6.5) that 

(3.10.4) R,iin + N) ~ aiB„(a +• — 1) ~ — «wliy(n) =0, n ^ 0. 

Then Bin) = (i2v(n))ii satisfies this same difference equation. Conversely if 
(3.10.1) is true for n ^ 0, it has already been proved in the course of the proof of 
Theomm 3.9 that the x(n) process is a component process of an iV-dimensional 
t.h.G.M. process. This finishes the proof of (ii). Parts (iii) and (iv) are proved 
similarly. 

Proof of ii). According to (ii), if there is a one-dimensional t.h.G. process 
whose correlation function Bin) satisfies (3.10.1) for n S 0, the process is a com¬ 
ponent process of an iV-dimensional t.h.G.M. process whose transition matrix 
A has (3.10.2) as characteristic equation. Since A has at least one characteristic 
value of modulus less than or equal to 1, (unless the x(n) process is of type 
Af{0)), (3,10,2) must have at least one root of modulus less than or equal to 1. 
Conversely if (3.10.2) has at least one such root, there is a real IV-dimensional 
matrix A whose characteristic equation is (3.10.2), and which has simple ele- 
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raentary divisors. According to Theorem 3.6 (ii), A is then the transition matrix 
of some t h.G.M. process. The correlation function of this process and hence 
that of each component process satisfies (3.10.1) for n g 0. 

Theorem 3.11. (i) // Oi, • • , oln are real numbers, there is a one-dimensional 

t.h.G. 'process not of t'ype M(0) salisfying 

(3.11.1) x{n N) — aix(n + — 1) — • • • — aNx(,n) = ij(n + N), 

n = 0, ±1, • • • 

'with i?(m), » 7 (n) independent for \ m — nl N if and only if (3.10.2) has at least 
one root of modulus less than or equal to 1, 

Let • ■ • , a;(0), x(l), be the mriables of a one-dimensional t.h.G. process. 
(li) This process is a component process of an N-dimensional t.h.G.M. process 
if and only if (3.11.1) is true imth ri(m), ri(n) independent for | m — n | ^ N. 
In this case ^(ti + N) 'will be independent of the chance variables ■ ■ • , x(n — 1), 
x(n). 

(iii) The process is a t.h.G.M. process if and only if in addition to the condition 
in (ii), 7i(n) is independent of the chance variables • • ■ , x(n — 2), x(n — 1): de¬ 
terministic case if i)(n) = 0 with probability 1, nondeterministic case otherwise. 

Since this theorem follows readily from the preceding theorems, the proof will 
be omitted. 

The problem of predictmg x(n) in terms of ■ • • , x{n — 2), x(n — 1) is trivial 
(theoretically at least) for t.h.G.M^-. processes. In fact these were defined as 
those processes for which the solution of the prediction problem is simply a 

linear combination 22 a,x(n — j) of the preceding N variables. The solution 

j-i 

will now be given for the more general class of component processes of JV^-dimen- 
sional t.h.G.M processes, processes which have been described from several 
points of view in the preceding theorems 
The prediction problem for component processes of iV-dimensional t.h.G.M. 
processes will be put into a more general setting. If the one-dimensional chance 
variables {x(?i)) determine a t.h.G. process, with correlation function R(n), 
the problem of finding ■ , x(n — 2), x(n — 1); x(n)] is that of finding a 

nc 

series 227ma;(n — m)“ such that 

(3.12.1) x(n) — 22 7 ma;(n - m) 

m—1 

is uncorrelated with every x(n — v) (p > 0): 

(3.12.2) R(v) - 22 7«ft(»' - m) = 0, r > 0. 

V»—1 


We are neglecting all convergence difficultiee. They become trivial for the applica¬ 
tions to be made below. 
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If the complex spectral function is G{\), (3.12.2) hecompR 

(3.12.3) =0, p = 0. 

Let (?(X) be the integral of its derivative G'(X), that is let ^(X) be absolutely con¬ 
tinuous. According to (3,12.3) the problem reduces to that of finding a function 


(3,12.4) 


/( 2 ) 



2 » C 


a 


such that/(a)(?' is of power series type, a function corresponding to an expansion 
in non-negative powers of z. The dispersion of the error of the prediction is 


(3.12.5) 


jE?||^x(n) - 2] 7m— m) | 


e. — 23 7m fi 




rfCn'-m)X 


dG(\) 




In particular if the x(n) process is a component process of an JV-dimenBional 
t.h.G.M. process, Cf(\) is given by (3.9.5). It will be supposed throughout the 
following that d s 0. Then 


(3.12.6) 


r'Vxi — 4- ... 4- -j, ■.. 

-I- ... -b aw)(ao ■+•••• -f wa^z'^) ’ 




In this case / s 1 if G' s 0, and otherwise / is given by 


(3.12.7) 
so that 

(3.12.8) 


f(2) -f • • ‘ + a^) 

" aoz(/9o2''-i + • • • + pH~i) 



The dispersion of the prediction error is iZ(0) if G's 0 and otherwise is 2iri33/ao. 
The prediction formula for x{n) in terms of the variables ■ • • , x(n — v — 1), 
x{n — v) has now been derived for v = 1, for the chance variables under discus¬ 
sion in this section. The solution for general v is easily obtained. 

As r -4 oo, the prediction converges with probability 1, according to the 
corollary to Theorem 1.2. If the process is a component process of an N- 
dimensional t.h.G.M. process, and if S' s 0 in (3.9.6), the limit is 0. That is, 
in this case, the best predicted value of x(n) in terms of the distant past is near 
E{xin)] = 0, the same predicted value which would be used with no knowledge 
of the past. 



GAUSSIAN PHOCESSES 


263 


4. Processes whose parameter t varies continuously 

The basic process in terms of which t.h.G.M. processes without deterministic 
factors were expressed in section 3 was a process whose variables {{(w)} were 
Gaussian, with 

(4.1.1) JS{f(n)} = 0. £({(m)-t(n)) = S„J. 

The corresponding process in the continuous parameter case is not obtained by 
replacing the integral parameters m, n in (4.1 1) by continuous parameters. In 
fact the process so defined does not satisfy any useful continuity conditions. 
In the present discussion, sums like X) Am((m) will be replaced by Stieltjes 

m 

integrals J A(t)d((i), and d((i) thus will correspond to f(n). The ((l) process 
is defined as follows. For any <•••</» , the chance variables 


i ( ti ) ~ • • • « f(^n) — f(fo-l) 


are mutually independent A^-dimensional Gaussian chance variables, and if 
s < t, 

( 4 . 12 ) E{m - = 0 . - f(s)]-[f(o - m] = (t - s)i. 


This process, called simply a f-process below has been discussed in great detail 
by Bacheher, Wiener and L4vy The function {(<), considered as a function of t 
is known to be continuous with probability 1.^’ The derivative i'it) does not 
exist, since + h) — {,(<)]’} is proportional to h, whereas this mean would 

be proportional to if {'(f) existed. In fact it has been shown that {(/) is 
(with probability 1) not even of bounded variation in any finite interval. How¬ 
ever, if /(/) is a function defined and continuous for a ^ t ^ b (where o or b or 
both may be infinite), the integral 


(4.1.3) 


f mm) 


can be defined as the limit in the mean of the usual Stieltjes sum. If /(f) has a 
continuous derivative, the integral in (4.1.3) can be evaluated by integration 
by parts: 

(4.1.4) £/(<) dKo = fmQ>) - mm - [ mm dt. 


Integrals of the following type will be used below: 

y{t) = [‘fit - r) dm -f(t - a)m 

+ f mnt - r) dr 


(4.1.5) 


”Paley and "Wiener, “Fourier transforms in the complex domain,” Am- Math. Soc. 
Colloq. Pvh., Vol. 19, p. 148. 



264 


J. i. DOOB 


where /(i) is continuous and has two continuous derivatives. It is then evident 
that y(() is continuous, but that y'{l) exiatH if and only if /(O) = 0. If /(O) = 0, 
y'{l) is given by 

(4.1.6) y'(() » //'«~T)4(r). 

•'a 

A more general process will also come into the discussion below, and will be 
called a f-process. The chance variables {J'(0} of a f-procesa are. (laussian, and 
have the same independence property as the variables of a f-procesa. The 
second equation of (4.1.2) is dropped, so that (4,1.2) is replaced by 

( 41 . 7 ) A’(r(o - f(o)i - 0. .g![f«) - r(o)i-[r(o - i-(o)]) - /xo, 

where the symmetric and non-negative definite matrix D(,l) will sometime.s be 
supposed to have special properties, such as continuity in t, etc. The inde¬ 
pendence property of the {"-process implies that 


(4.1.8) £([r(() - {■(8)]df(f) - r(s)]l = D(l) - D(8). 


Hence D'{t) (if this derivative exists) is Hymmetric and non-negative definite. 

Theorem 4.1. If the dispersion matrix Dit) of a t^-procr.ss is continuous, Die 
functions {{"(01 nre continuous in i, with probability 1. 

The component processes of a {"-process with a continuous dispersion function 
are also {"-processes with continuous dispersion functions. Hence it will be 
sufficient to prove the theorem in the one-dimensional ra.se. In this case D{l) 
is non-negative and monotone non-dccrcosing, according to (4.1.7) and (4.1.8). 
It can be supposed that D{t) docs not vanish identically. I/ct D\{t) be an inverse 
function of D(t): I>[Di(l)] = t. Then J(l) = i"[^^i(0] defines a f-process, and the 
continuity of f(0 implies that of {"(i). 

The integrals of type (4,1.3) are defined for {"-procesHea as for ^processes, and 
satisfy the equations 


(4.1.9) 


i;|/^/(t)d{"(f)| = 0 

E I £ fit) dm • £ ff(t) dtioj = £ mm'it) dt 
Je|£ A(«) dm-f Bit) = f Ait)D'it)Bil)* dl. 


where /, g are numerically valued functions and A, 5 are matrix functions.** 
The {"-processes lie at the basis of t.h.G. processes. To every t.h.G. process 
(discrete parameter) with variables (x(n)) correspond two one-diroensional 
{•-processes with variables \tiit)}, l{' 2 (i)} such that 


(4.1.10) 



cos n\ dfXX) ■+• sin nX d{‘j(X) 


“ These equations are easily proved using the fact that each integral oan be approxi- 
mated by the usual Riemann-Stieltjes sums. 
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where the two f-procesaes are mutually independent in the sense that every 
fi(Xi) IS independent of every i'jCX*) and where, if G{X) is the complex spectral 
function of the process, 

(4.1.11) = G(\). 

In the continuous parameter case (4.1.11) becomes 

(4.1.12) x(t) = cos fX dfi(X) + sin tXdl' 2 (X).^“ 

This theorem of Cram6r shows that ^(n), or x(t) as the case may be, is the limit 
of a sum of sines and cosines, with Gaussian chance variables as coefficients. 
The dispersion of each coefficient, which measures the intensity of the cor¬ 
responding periodic term of the sum, is determined by the spectral function of 
the process In particular, if the spectral function F(X) is the integral of its 
derivative ^’'(X), each integrand involving in the above equations can be 
replaced by one involving ■\/F'{X)d^t(X) where £,(X) is the variable of a ^-process. 
Thus in many important cases the processes can be written in a simple way in 
terms of ^processes 

It will be shown below that every t.h.G M. process can be represented as the 
direct product of factors of certain types The deterministic types have already 
been catalogued: M(0), M(l), M(e'‘*) The standard non-deterministic type, 
as in the discrete parameter case, will be called type M. 

M Let {f(0) be the chance variables of an IV-dimensional |-process, as de¬ 
scribed above. Let Q be an A^-dimensional square matrix, and let S be an N- 
dimensional symmetric non-negative definite matrix. Define x{i) by 

(4.2.1) x{t) = f e'^Sd^H-s) = r df(r) 

Jo J-w 

where it is supposed that the improper integrals converge with probability 1. 
There will be convergence, for example, if Q has only characteristic values with 
negative real parts so that the elements in the matrix go to 0 exponentially 
as s —> 00 . (Cf section 1) It will be shown below that it is no restriction to 
assume that Q has this character. The x(t) process is evidently a t.h.G process. 
If li < <, the chance variable 

(4.2.2) x(t) - e'‘-“^«x(w) = f* e"®Sd{(s) 

is independent of x(v) for v ^ u, since x(v) is expressed in terms of {(s) for s ^ v. 
Therefore the x(i) process is a Markoff process with transition matrix A(<) = 

(4.2.3) E{x(r),i; ^ u; x{t)) = e'^~'‘^'^x{u), u < t. 

“ H. Cramer, Arkit For Matematik, Asironomi och Fysik, Vol. 28B, No. 12, pp. 1-17. 
Cram6r only discuBsea the continuous parameter case, but the other requires no change of 
method. He allows complex-valued t-prooesses, in terms of which (4,1.10) and (4.1.12) 
assume a more elegant form 
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A process defined in this way will be called a prt>ce8s of type M. A change of 
variable 2/(0 = Bx(0 leads to a process of the same type: 

(4.2.4) y(0 = f - s). 

The matrix Q goes into BQB and if SiO is the polar form of BS, where S is 
symmetric and non-negative definite and 0 is orthogonal, jS goes into Si. (We 
are using the fact that 0^(0 defines a second f-process.) The correlation func¬ 
tion of a process of type M is easily calculated: 

(4.2.5) R(0) ^ ds, R(t) - ft(0)e'‘’'. 

The only condition imposed on Q is that the improper integrals in (4.2.1) con¬ 
verge. This condition ia easily seen to be equivalent to the convergence of the 
integral in (4.2.5). This in turn is equivalent to the condition that 

(4 2.6) lime‘®5»>0. 

This condition is certainly satisfied if the characteristic values of Q all have 
negative real parts, and it can always be assumed that this is so. (Cf. the cor¬ 
responding discussion of processes of type M in the discrete parameter case.) 

The analogues in the continuous parameter case of Theorems 3.4 and 3.5 are 
true. The proofs are substantially the same as the proofs in the discrete param¬ 
eter case, and will be omitted. 

Theorbm 4.3. (i) Every t.h.O.M. -proceas (conlinuoua parameter) ia the direct 
product of processes of type Af(0), Mil), M(e‘'), M, 

(ii) If x(t) are the variables of such a process, there ts a matrix Q such that A(l) = 
e'" is a transition matrix function. There is a ^-process, a Oaussian variable f, 
independent of the f(t), satisfying 

(4.3.1) = 0, = / 

and symmetric noormegatwe definite matrices S, T such that 

x{t) = e'^ S diit - s) + 


(4.3.2) 

= ]^%“-’®Sdt(8) -f =. j^'e''-“»Sdt(8) e'«x(0), 

(4.3.3) 

QT^ + T*Q* ^ 0, 

(4.3.4) 

R(fi) = e“’S’e*®* ds -1- r 

(4.3.6) 

QRiO) -f R{0)Q* - -S*, 


where the integrals in (4,3.2) converge vnih probability 1. The integral and the 
last term in each pair in (4.3.2) are linear transformations of x(/): (4.3.2) exhibits 
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in part the decomposition into faetor processes described %n (i). 
function is given by 


(4.3.6) 


R{t) = 
R{-t) = 


The correlation 


(lii) The matrix Q is uniquely detmmned if and only if the process is non¬ 
degenerate. In any case there is a Q whose characteristic values all have negative 
or zero real parts and whose characteristic values with zero real parts correspond to 
simple elementary divisors. The matrix Q furnishes the solution to the prediction 
problem of the process. 

{4.3.7) e ^ t, x{t + m)) = e“*x(<), u > 0. 


The matrix S, which is uniquely determined, measures the dispersion of x{t) about 
its predicted value: 

(4.3.8) E{[x{t + w) - e'‘^x{t)f] = 22(0) - e’'«22(0)e’'«' - (u 0) 

(iv) Conversely if Q is a matrix with at least one characteristic value with negative 
real part or with zero real part and corresponding to a simple elementary divisor, 
e‘^ is the transition matrix function of a t.h.G.M. process with RiO) not the null 
matrix. If all the characteristic values of Q are as just described, e‘® is the transi¬ 
tion matrix function of a non-degenerate i.h.GM process. If R{0), S, Q are 
matrices satisfying (4,3.5) with RiO), S symmetric and non-negative definite, there 
IS a t.h.G.M. process whose variables can be written in the form (4 3.2) vnth the 
given RiO), S, Q 

The proof of Theorem. 4.3 follows closely that of Theorem 3.6, and the details 
will not be given, except as they differ from those of the earlier proof. 

Proof of ii). Suppose that the {x(<)) are the variables of a t.h.G.M. process 
which is non-degenerate. The transition matrix function Ait) is then uniquely 
determined by (1.5.5). Take the conditional expectation of both sides of 
(1.5.4) for given x(0): 


(4 3.9) A(s -t- t)xtSf) = A(<).4(s)x(0) 

Since the process is non-degenerate, 

(4.3.10) A(s -k 0 = ^(s)A(<) 

According to (1.3.1) and (1.5.5) 

(4.3.11) - lim Rit) = lira 22(0)A(<)* = fl(0), t > 0. 


s, t > 0 

s,t> 0. 


lim A(<) = 7. 

l-*0 


Hence 

(4.3.12) 
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It has already been noted that any solution to (4.3.10) under the continuity 
hypothesis (4.3.12) can be written in the form 

(4.3.13) .4(0 = e'", 

where 


Q 


lim 

(-*0 



1 


Under a change of variables y{t) = d,(0 becomes and Q becomes 

BQB~'^. According to Theorem 2.1, if the x{t) process is degenerate, it is the 
direct product of one or more factors of type M(0) and (perhaps) of a non¬ 
degenerate factor. The matrix Q of a factor of type M(0) can be taken as the 
null matrix. Then the form (4.3.13) is admissible for any t.h.G.M. process, 
although Q will only be uniquely determined if the process is non-degenerate. 
Define f(0 by 

(4.3.14) f(0 = A(0“‘x(0 = e“‘''a:(0. 


Then if Si < h < sj < 


(4.3.15) £lr(/0 - f(8,)l = 0, ®((f(fe) - f(s»)].[r(ii) - f(8,)]l = 0 

and 


(4.3.16) D(i) = Em - f(0)]-[f(0 - mil = - R{0). 

Hence the (f(0} determine a f-process, with dispersion matrix given by (4.3,16). 
The derivative Z)'(i) is easily evaluated; 

(4.3.17) D'{t) = e~^^[-R{0)Q* - QR{0)]e~“‘‘. 

Since D'{l) is symmetric and non-negative definite, the bracket also has this 
property, and there is a non-singular matrix Si such that 

(4.3.18) Si[-QR(0) - R{0)Q*]St = U, 

where C7 is in diagonal form, with only O’s and I’s in the main diagonal. Then 
the integral 

(4.3.19) f Sie'U^is) 

Jit 

defines a f-process with dispersion matrix tU, There is therefore a {-process 
with variables ({(0) such that 

(4.3.20) Um ^ Sie'Uas). 

This equation can be solved for f(() and x(i) : 

(4.3.21) x(i) = e'‘'f(0 = e'* t/ df(«) + e'«i(0) 
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where S 2 = Si^. The matrix S 2 U can be written in the polar form SO where S 
IS symmetric and non-negative definite and 0 is orthogonal This S is the S 
of (4.3.2) etc. 

The remainder of the proof follows closely the proof of Theorem 3.6 and will 
be omitted. 

An important class of t.h.G.M. processes which arises frequently m physical 
applications is obtained in the foUowmg way Let {{(0) be the variables of a 
one-dimensional f-process. Consider the formal equation 


(4.4.1) 


ry{i) _ 

dt" 




where Oj, ■ • • , as ,c are constants. This equation cannot be considered precise 
as it stands, since {'(0 does not exist. The problem can however be reformulated 
as follows: find a y{i) process, where y', ■ • • , are supposed to exist, satis¬ 
fying the equation 


(4.4.2) 


fm - ai dy^”-^\t) - 

•'a 

- O'lf j fii)y(fi di = c j fit) d^it) 


with probability 1, for each continuous function fit) and each pair of numbers 
o, b. The formal integrals are defined as the limit in the mean of the usual 
suinB.^° The integral on the right has already been discussed With this 
interpretation, equations involving can be treated in the usual way, and this 
will be done in the following without further comment. The formal solution 
of (4.4.2) is well known. Let Xi, • • • , Xw be the roots of the equation 


(4.4.3) 


X" - aiX'^“‘ - • • • - a„ = 0 


and suppose that these roots are distinct, and have negative real parts. Let 
Ajk be the cofactor of X*“^ in the determinant 


(4.4.4) S = 


1 

• 

1 

Xi 

X 2 

■ XfV 

xr 

xr • 

^N-l 
• Ak 


Then the general solution of (4.4.1), that is to say of (4.4.2), is 
(4.4.6) yit) df(a) + j E Awe''‘i/'*-"(0). 

0 Jo ,-l 0 f.h-l 


Since the integrand and its first N — 1 derivatives vanish when s = t, y', • , 

as defined by (4.4.5) exist, but y^^^t) does not exist, because $'(<) in (4,4.1) 


” Fgr a full discussion in the case XT = 1 cf. Doob, Annals of Math., Vol. 43 (1942), pp. 
358-61. 
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does not exist. The j/(i) process is a t.h.G. process if j/(0), • • ■ , y'" “(0) are 
chosen properly. This can be seen from the solution 

(4.4.6) y(i) = T / 23 dfCs). 

0 J-ao 


In fact this is the only solution defining a t.h.G. process. To prove this, rewrite 
(4.4.5) m the form 

(4.4.60 y(t) = ^ E Ayy f d{(s) + - Z y'*-“(r)- 

If the y{t) process is a t.h.G. process, (4.4.50 becomes (4.4.6) when t —> — 
Thus there is a unique stationary solution to (4.4.1) and, by (4.4.5), every solu¬ 
tion tends to this solution in the long run. The stationary solution (4.4.6) 
has the property that y{t) is written in terms of f(s) for s ^ t. Then in (4.4.5) 
the integral is independent of the terms involving the initial conditions. In 
other words 


(4.4.7) E{y(8), s^0-,yit)} A*ye^'‘y‘‘-»(0). 

Hence the variables y{t), y'{l), ■ • • , 2 /^^“''(i) define an Af-dimenaional t.h.G.M. 
process. The transition matrix function A(0i and the matrices Q, S, T of 
Theorem 4.3 are easily calculated. 

A(j):(A«X^-^s^"), 


(4.4,8) 


< 3 ; 


0 1 0 0 o\ 

0 0 1.0 


r = 0. 


The necessary changes to be made if the X,- are not distinct are well known. 
The case c = 0 will be treated below, when the problem will be reconsidered 
from another point of view. In all cases the solution of (4 4.1) leads to an 
jV-dimensional t.h.G.M. process.’^ 

As a simple example, consider a torsion pendulum, suspended in a sealed 
container. The only turning forces acting on the pendulum are the molecular 
shocks of the surrounding gas, and the restoring torque. The equation of mo¬ 
tion is 

(4.4.9) / ^ + aMt) - X(t), 


*' According to a letter from Uhlenbeck, the differential equation (4.4.1) waa solved; 
from a somewhat different point of view, by Miss Ming Chen Wang, in a thesis written in 
1941 which is unfortunately inaccessible to me at the moment. 
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where y is the angular displacement measured from the equilibrium position, 
7 IS the moment of inertia, at is the torque coefficient of the suspension, and the 
molecular force is resolved into a systematic Stokes term a\y' and a remainder X. 
The remainder term X{l) defines a stationary process which to a first approxima¬ 
tion is “purely random.” In the present context “purely random” means that if 
ii < •' ■ < U , X{ti), • • ■ , X{t,) are mutually independent. This is precisely 
the property the derived process of a {-process would have, if {'(/) existed. 
Unfortunately it has already been noted that {'(/) does not exist, since the dif¬ 
ference quotient [{(i h) — ^{i)]/h is unbounded as h —> 0. It has already 
been seen, however, that (4.4.9) can be given a meaning with X(t) identified 
with c^'(t) even though {'(<) does not exist, and it has been seen that the solution 
approaches a steady state. It may still be a disappointment to some that the 
solution y(i) has a first derivative y'(t) but that y"(i) does not exist: there is an 
angular velocity but not an angular acceleration! This unhappy circumstance 
can either be blamed on the physical world, or on the mathematical approxima¬ 
tion to the physical world, depending on the point of view. The corresponding 
electrical picture is the following. There are spontaneous currents in any 
electrical circuit, due to the thermal motion of the electrons. This is known as 
the Johnson effect. In a simple closed circuit, consisting of an inductance L, 
a resistance, R, and a capacitance C in series, the current equation can be written 
in the form 

(4,410) L^^+R^>+f.XV), 


where y is the charge on the condenser and X(t) represents a fictitious voltage 
set up by the motion of the electrons. The X(t) is identified with c{'(<) as 


before. 


du 

In this case there is a current , but the current function has no 

at 


derivative. In these appUcations, the physical justification for the Gaussian 

character of the {-distribution lies in the Gaussian character of the Maxwell 

distribution of elementary particle velocities. The known mean particle kinetic 

energy determines the constant c in (4 4.1). The more complicated mechanical 

or electrical systems will lead to equations of higher order than 2, or systems of 

equations. For example the usual current equations of a net or resistances 

capacitances and inductances lead to a system of say r second order equations 

of type (4.4.10), and the corresponding pairs y, y' form a 2 inlimensional t.h.G.M. 
22 

process. 

The processes defined by linear differential equations of the type (4.4.1) are 
the analogues of the t.h.G.Mjv^. processes in the discrete parameter case. Instead 
of defining these solutions of (4.4.1) as the t.h.G processes, however, we 
shall use a definition closer to the definition in the discrete parameter case. A 


” Further discusBion and references to papers by physicists on this subject will be found 
in Doob, Annals of Math., Vol. 43 (1942), pp. 351-99. 
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one-dimensional t.h.G process with variables {v(i)) will be called a t.h.G.My. 
process if the derivatives y'(t), ■■ ■ , exist, and if whenever s < I, 

(4.5.1) Bly(T), r ^ s; y(i)} = ^{y(s), y'(s), y(i!)l- 

If A'' = 1, the process is a t.h.G,M. process. The nght hand side of (4.5.1) 
is a linear combination of the variables y(s), ,y^^'*’(s). The variables 

{2/(0) thus satisfy an equation of the form 

(4.5.2) 2/(0 - ai(l - s)y(fi) - ••• - Oy(f - s)y''*~"(8) = v(s, t) 

where vis, 0 is independent of the variables {y(T)) for r ^ s. Define the vari¬ 
ables (i(0} of an AT-dimensional t.h.G. pi’oce.ss by 

, , xi(0 = 2/(0 

(4.5.3) 

xj(t) = v^’\0, j = 1, ••• ,iV- 1. 

If this process is degenerate, there is a relation of the form 

JV-l 

(4.5.4) coy(s) + ciyTO + ■' • + cy_iy^~‘(s) =0, £ | c/1 > 0. 

1-0 

It can be assumed that Cy_i ^ 0, (differentiating (4.5.4) to get a term in 
if there is none originally). Then y^^"‘*(8) can bo eliminated in (4.5.2), to get 
a relation of the same type with N' replaced by fV — 1. Hence the process is 
non-degenerate if N is the minimum index for which (4.6.1) is true. It will now 
be proved that the a;(0 process is a t.h.G.M. process. It can be assumed to be 
non-degenerate. Using (4.5 1), 

(4.5.5) J5{x(t), t ^ 3;xi(01 = E{y(T), t ^ s;y(0} = .B|x(s); xi(0). 

It must also be shown that 

(4.5.6) i;{a:(r), r g s; Xj(0} = A’la:(8); a:y(01 j = 2, • • • , A^. 

This will be shown by justifying the taking of derivatives in (4.5.5). It will be 
sufficient to prove (4.5.6) when 3 = 2. Using (4.5.1), 

(4.5.7) £{x(r), r ^ 3 , y(f+ ^ - - y(0 | ^ ^ + 

The right hand side is a linear combination of xi(8), • • • , xy(s) whose coefficients 
are continuous in h, h ^ 0, since the correlation function of the y(t) process is 
continuous. Hence the right hand side converges to 

£la:(3)i y'(0) = S{x(3); x,(01 

when A —► 0. Since the difference 

x(0 - s|x(3);^^^-±-?^-::^j 
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is uncorrelated with xCt) if t ^ s, the same is true of its limit as /i -+ 0 . This 
means that (4.6.6) is true when j = 2, as was to be shown. Conversely if {y(t )) 
are the variables of a one-dimensional t.h.G. process, if y'(t), ■ ■ ■ , 
exist, and if the a:(<) process defined by (4.5.3) is a t.h.G.M. process, the yit) 
process is obviously a t.h.G.M;^. process. The transition matrix function A(t) 
and the matrices Q, S, T of Theorem 4.3 are easily calculated. Suppose that 
the x(t) process is non-degenerate. Since y^'~^\i) is given by 


(4.5.8) 


= x,(t) = f‘ -f 

j—I j«-l 

= ft [e“-*'"^]odfy(s) + t (c'")«^y(0) 

Jo ,-l ].l 


and smce Xi{t) exists if f < N, it follows that the integrand must vanish when 
s = t: 


(4.5.9) (S)., = 0, i = 1, . - • , i\7 - 1, j = 

Since S is symmetric and non-negative definite, S must have the form 

'O • • • O' 


(4.5.10) 


S; 


• 0 
0 c 


The fact that — x<+i(<) means that 

(4.5.11) f: («'" Qhxm = t (e‘®).+i,xy(0), 

3-1 3-1 

or, since the x{t) process is non-degenerate, 

(4.5.12) {e‘^Q)ii = {e*%+n 
Hence (< —> 0) Q has the form 


(4.5.13) 



0 1 0 


• 0 ' 

0 1 

• oi, 


c ^ 0. 


j = 1, ■ • ■ 3 AT 


Conversely if there is an iV-dimensional non-degenerate t.h.G.M. process with 
transition matrix function e‘° where Q is given by (4.6.13) and dispersion matrix 
S given by (4.5.10), 

^i(0 ~ 2;<+i(t), t = 1, ■ ■ ■ , 1, 

and the Xi(t) process is a t.h.G.My. process. 
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Case 1. iS — 0 {deierminislic case). In this case the x(i) process is deter¬ 
ministic: 

(4.5.14) x{i) = 

Since Q satisfies its characteristic equation 

(4.5.15) a" - aia"-' ~ - ftv = 0 

it follows that 

(4.5.16) - ... - = 0, 

(4.5.17) - a,y‘^-‘>(0- a^yii) = 0. 

The roots of (4.5.15) are simple roots, and are all pure imaginary, according to 
Theorem 4.3. It follows that 

(4.5.18) y{l) = ^ (it) cos IGj -f fj 8in td,) 

7 

where the ii, and fy are one-dimensional Gaussian variables, and (iffy) are the 
distinct roots of (4 6.15). 

Case S. jS 5^ 0 {nortrdeterminislic case). In this case it will now be shown 
that the a:(0 process has no deterministic factor, that is that the roots of (4.5.15) 
all have negative real parts. In fact let be a root of (4.5.15), corresponding 
to the characteristic vector e of Q*: 

(4.5 1^) z — {asp'* \ ^ -|- a/r-Tp^ *i ■ ■' > av -h an-ip + • • • + fljjS^’"^) 

= {--^P^). 

Then using (4.3.5) 

0 < c’ I /3 I = {S\ z) = -(/2(0)Q*z, z) - iQR{0)z, z) 

(4.5.20) = - HR{0)z, z) - MR(0)z, z) 

= -(X 4- %)(R(0)z, z). 

Hence X 4- X is real and negative: X has a negative real part. In this non- 
detenninistio case, therefore, the x(t) process can have no deterministic factor. 
The matrix T is the null matrix, and (4.3.2) becomes 

(4.5.21) a!(t) = jf* e<'-*’®S(i{(s) 
which leads to 


(4.5.22) 


y{C) dfA’(s). 
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Moreover 


(4.5.23) 


y'(l) = c £ dUs) 

■^00 


Since Q satisfies its characteristic equation (4.5.15), 

(4.5.24) f [Q^6^* *^^]iy d^n(s) — 2 f d^t/(s) = 0. 

J-^ee w—oA 

In other words 

(4.5.25) c [‘ dM - -■■■ - aavit) = 0. 

Now formally, if {y(^) existed, the last equation in (4.5.23) could be differentiated 
to give 

(4.6.26) = c[Q^-^]xye;(<) +c [QV-%^ dUs) 
and (4.6.25) would become 

(4.5.27) ^^"'(0 - - aMt) = 

(We are using the fact that (Q^~^)iy = 1.) Thus the t.h.G.Mjy. processes satisfy 
the formal differential equation (4.5.27) already discussed above from another 
point of view. Equation (4.4.2) is readily justified. 

Theorem 4.6. (i) Let (x(t)} be the variables determimng a t,h.G.M. process. 
Then considered ns functions of t, the x{t) are continuous vrith probability 1. Let 
{^(01 — {2^r(0} variables of a coordinate process. 

(ii) If y'{t) exists, it is a linear combination of coordinate functions: 

N 

y'it) = 

(lii) If y'{t), • ■ , exist, y(t) satisfies a generalized differential equation 

(4.4.1), that is the y{t) process is a t.h.G.My. process. 

(iv) Ify'it), ■ ■ • , (/) exist, y{t) has derivatives of all orders. The y(t) process 

is a t.h.G.Mff. process (deterministic case) and y(t) therefore satisfies an Nth order 
homogeneous differential equation (4,5.17). 

(v) If Xi(t), • ■ • , Xif(t) exist, that is if x'(t) exists, thex(t) process is deterministic 
and the coordinate functions have derivatives of all orders. 

Proof of (i). It has already been shown that the (f(01 determmed by (4.3.14) 
determine a f-process, and the dispersion matrix function D(t) of the f-process, 
given by (4.3.16), is certainly continuous. Hence, by Theorem 4.1, the {r(t)l! 
and therefore the {x(i)l ^.re continuous in i, with probability 1. 
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Proof of (m). If Xr(i) exists, the rth row of S in f4.3.2) must vanish, and Xr(/) 
is given by the rth coordinate of 

(4.6.1) Qe'*-*'" S dm + Qe"* ^(0) = ■ 


Hence 


(4.6.2) 


a:r(0 = S (Q)riXjit). 
1-1 


Proof of (ni). Suppose that Xr(t), ”(<) exist. Then (r is fixed in 

the following equations) 

Xr(t) = ft -?].ydfy(a) + t nxj(0), 

i-l 1-1 

(4.6.3) “ a S + S 

= ft »S].ydfy(«) + t [e'‘’C'"“']xy(0) 

Jt i-i i-i 

and (in order that the derivatives can exist) 


(4.6.4) 


SrJ =• 0 
(QS)rJ =* 0 

(Q""’£0ry - 0, 


j = 1, • • • , N. 


Since Q satisfies its characteristic equation, say (4.5.15), 

(4.6.5) df(a) “ ^ dm =■ 0. 

This vector equation can be written (using only the rth coordinate) in the form 

(4.6.6) f t Q'^-Sriryd$y(s) - ay/-^\l) - - a,,Xr(t) = 0. 

/-I 

If |'(0 existed, the last equation in (4.6.3) could be differentiated to give 

(4.6.7) xi”\t) ^ f t O'"-S],ydfy(«) + t [Q^"‘-S],yf;(/) 
and (4.6.7) would then become 

(4.6.8) - atx^/-^\t) - anXrit) » t (0*^~‘S)ryi/(0. 

i-l 

Now the process with variables 


(4.6.9) 
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is a f-process, if c is chosen properly, unless the parenthesis in (4 6.9) vanishes 
for all j. In either case (iii) is proved. 

Proof of (id). If m (iii), x'f^{t) exists, (4.6.3) can be augmented to include 

(4.6.30 r^^’(t) = E + E [e‘«Q^]xX0) 

iiL-ae jmI 

and (4 6.4) now includes 

(4 6.40 (Q'"‘S)ri = 0, j = l, .. ,N. 

In this case the last term in (4 6.7) vanishes and (4.6.8), with zero on the right 
hand side, is strictly true 

Proof of (a). If a:i(0) , X),{t) exist, S must vanish and (4.6 3) yields 

(4.6.10) x{t) = e'MO), = Q'’xit) 

Thus the a:(f) process is deterministic and a;(<) has derivatives of all orders 
Theorem 4.7. Let (a:(i)} the vandbles of a one-dimensional t.h.G. process. 
The process is a component process of an N-dimensional i.h.G.M. process if and 
only if the chance variables 

(4.7.1) x(0), ’(P|i(s), s ^ 0; x(f)}) 0 < f < «> 

are linearly dependent on N variables. 

Suppose that the x(t) process is a component process of an ^-dimensional 
t h.G.M. y(t) process; x(^) = i/r(t), and let A(f) be the transition matrix function 
of the y(t) process '"hen if « > 0 and if n is any integer, the difference 

yl(n + 1)«] - A(e)y(ne) 

is independent of every y(s) with s £ ne, and therefore independent of every 
y(m() with m ^ n. Hence the y(nt) process is a thG.M. process (discrete 
parameter case) Equation (3 8 5) becomes, in this CEise, if n = 0, 

(4 7 2) x[(N + - ai"^ x[(N - l)e] - ■ - a^‘’>x(0) = -f p) 

where + v) is not merely independent of the variables • • • , x(—e), x(0), 

but is even independent of every x(s) with s ^ 0. It then follows, applying the 
operator P(x(s), s ^ 0;-) to both sides of (4.7.2), that the variables in (4.7.1) 
are linearly dependent on N variables if ( is restricted to be a multiple of «. 
Allowing e to run through the values 



it follows that the statement of the theorem is true if t is restricted to be rational. 
The proof will be complete when it is shown that the subject^^ variables for ra¬ 
tional t are dense in the whole class in the sense that for any i, the expectation 

(4.7.3) 5 = jB{[E(x(s), s g 0; x(0} — E[x{s), s S 0; x(0]f} 


>• Courtesy of U. S. Navy 
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converges to 0 when t' —> i. In fact, using the Schwarz inequality 
(4 7 4) * “ ^ 0; xit') - x(f))f) 

■ ^ s{E(x(s). s ^ 0, [x(o - xcori 1 = E{[x{n - x(ori 

and the basic continuity hypothesis (1.3.1) imposed on continuous processes is 
precisely that the last expectation converges to 0 when t' -* t. 

Conversely suppose that the chance variables (4.7.1) arc linearly dependent 
on N variables. It can be supposed that j:(0) is one of theac N. Ixit the others 
be those for which i - k ly , and define i/j(t), • • ■ , yyil) by 


(4.7.5) 


yiit) = xit) 

VAi) = EIx(3), s g t; xit + <j) j = 2, • ■ ■ , JV. 


The yit) process is obviously an TZ-dimensional t.h.G. process. Moreover 


(4 7 6) ® s ^ 0; i/;(0} 

= S(x(s), s S 0;x(t +f;)l 

(where k is defined as 0). Since the right side i.s by hypothesis, for each j, a 
linear combination of yAO), • • • , ya(0), the yit) process is a t.h.G.M. process, 
and the x(<) process is a component process, as was to be shown. 

A detailed examination will now be made of t.h.G.Mj/. processes, and of the 
more general class of component processes of t.h.G.M. processes. The following 
theorem will be useful. 

Theorem 4.8. Let [xit) | be the variables determining a t.h.G. continuous param¬ 
eter process. The process is a component process of an N-dimensional t.h.G.M, 
process if and only if for each e > 0 the discrete parameter process with variables 
{x(7ie)) is a component process of an N-dimensional t.h.G.M. process. 

If the xit) process is a component process of an A’-dimensional t.h.G.M. yit) 
process, the i(Tit) process is a component process of the iV-dimensional t.h.G.M. 
vine) process. Conversely suppose that the xint) process is a component process 
of an iV-dimensional t.h.G.M. process (which may depend on e) for every f > 0. 
It follows that for each e > 0 the chance variables 


(4-8,1) E{ ■ ■ • , x(—e), a:(0); x(n t )!, n = 0, 1, • • ■ 

are linearly dependent on N of their number Hence the same is true of the 
following chance variables, if v, m are fixed and v > m: 

(4.8.2) E\ ■ ■ • , x( —l/vl), x(0); xin/m] n ~ Q, 1, ■ ■ ■ . 

According to the Corollary to Theorem 1.2, when v —> co the conditional expecta¬ 
tions in (4 8.2) converge to 

(4.8.3) £^{x(s), s g 0, s rational; xin/m)] 


n = 0, 1, . 
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Hence the chance variables {t rational) 

(4.8.4) ,E[x{s), s ^ 0, s rational; x(«)) = E{x{s), s g 0; 

0 < i < .=0, 


are lineaz'ly dependent on N of their number. As in the proof of Theorem 4.7 
it follows that the same is true if t runs through all positive real numbers, and 
according to Theorem 4.7, the x{i) process is therefore a component process of 
an A"'dimensional t.h G.M. process. 

Theorem 4.9. Let {x(J)i be the variables of a one-dimensional continuous 
parameter t.h.G. process. The process is a component process of a finite-dimerv- 
sional t.h.G.M. process if and only if the complex spectral function of the process 
is the sum of the integral of the square of the absolute value of a rational function of 
X and of a mono'one non-decreasing function increasing only in a finite number of 
jumps Specifically:. 

(i) The process is a component process of an N-dimensional t.h.G.M. process if 
and only if the complex spectral function has the form 


(4.9.1) 


OCX) - f 


I j3o(tX) + • • • + djy-i I 

(iX)^ + m(^■X)^-'+ ••• + ajv 


, d\ + Cr{\) 


where 

(a) §(X) is a monotone non-decreasing function satisfying (1.3 3) and increasing 
only in jumps, at no more than N points. 

(b) the denominator of the integrand vanishes at every discontinuity of &(X), and 
the rvumerator vanishes at every zero of the denominator, to at least the same order ; 

(c) the coefficients in the integrand are real, and the roots of the X polynomials are 
all on the real axis or in the upper half plane 

The integral vanishes identically if and only if the x{n) process is a component 
process of an N-dimensional deterministic process, and 0{\) vanishes identically if 
and only if the variables {x(i)) vanish identically or the x(t) process is a component 
process of an N-dimensional t.h.G.M. process with no deterministic factor. 

(ii) The process is a t.h.G.M k. process, in the deterministic case, if and only if 
the complex spectral function G*(X) = ^(\) is a function increasing only in jumps, 
at no more than N points; non-deterministic case if and only if the complex spectral 
function has the form 


(4.9.2) 



cdk 


“ The equality (4.8.4) is proved as follows. Let t be fixed, and let x be the chance Vari¬ 
able on the left. Then x{t) — x has mean 0 and is uncorrelated with every *(*) with « S 0 and 
rational. It follows at once from the continuity of hypothesis (1.3.1) that then a:(f) — xis 
uncorrelated with every x(s) with « £ 0. it follows that (4.8.4) is true. 

*• It is easily seen that the first term of the two can also be described simply as the in¬ 
tegral of a rational function of X, which is non-negative for real X and is integrable And an 
even function, like all complex spectral density functions. 
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Proof of (i). Suppose that the z(J.) proceaa is a one-dimenHional component 
process of an iV-diraensional t.h.G.M. y{t) process, xit) = It is no restric¬ 

tion to assume that the y(t) process is non-singular. Then the correlation func¬ 
tion of the yit) process is given by 

Ry(l) = 

(4.9.3) 


Ry(t) = 

where Q is uniquely determined and 


i S 0 

I £ 0 , 


0{\) - 0(0) 


(49.4) 


'i 

_27 


r 




2r 


it 


■ Ry{t) dt 


Jii 


i f 

2ir L 


» gVA _ 1 


it 


[iJvCOJu dt, 


at the points of continuity of (7(X). 

The correlation function i2„(0 has derivatives of all orders for i > 0: 

Rif^t) = i?,(0)Q*'e‘«’ i > 0 

(4.9.5) 

- (-l)'e’c-'‘’R,(0) f<0. 

Suppose first that the y(t) process has no deterministic factor, in other words 
that it is non-degenerate and of type M. Then the characteristic values of Q 
have negative real parts and R(t) —r 0 exponentially when | < | —► . Hence 
(?(X) has a continuous derivative ^'(X); 


(4.9.6) O'fk) 

Integrating by parts, 

G'(X) 


l£e'‘'[fi:,«)]ndh 


1 


(4.9.7) 


_ fi:(o-b) - ^^(0-) 

2,r(tX)“ ■^2irI-(iX)* 

= fiv(0+) - RUO-) _ fiy(O-f) - R'J(0-) _ ± r_i 




2r(iX)> 


27rJL, (tX)' 


R'J'd), 


Since Q satisfies its characteristic equation 
(4.9.8) — Oia^ ^ ■ — an =™ 0, 

it foUows that 

Rl^'^t) - - - anRy{t) - 0 <> 0 

-h ayRi’'-'\t) - .. ■ -h (-1)^-’72,(0 =0 Z < 0 
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and therefore if V is the operator — 

at 


(4.9.10) 


[U^ - OiC/''"' - 




Applying (4.9,.10) to (4.9.6) 

[(iX)^ — ai(iX)^~^ _ ... _ aj^][(iX)^ + ai(i\)^ * 4- ■ ■ ■ 

(4.9.11) + (-l)''"‘ow]<?'(X) 

= I (iK)” - ai(rX)'^-‘ - ■ • • - ay |“(?'(X) = P(i\) 


where P(iX) is a polynomial of degree 2n — 2. Since P(iX) is real and non¬ 
negative, when X is real, the roots on the real axis are of even multiplicity and 
those off the axis are symmetric in the axis. Moreover P(i\) is even, since the 
left side of (4.9.11) is even. It follows easily that P(rX) can be written in the form 


(4.9.12) 


P(z\) = 




1-0 


|2 


where the roots of the d polynomial are all on or to the left of the imaginary axis. 
Finally 


(4.9.13) 


••• +^v-i|* 

^ l(tX)'^- ... - ay p 


The denominator polynomial in X vanishes only at points where iX has a nega¬ 
tive real part, that is where X has a positive imaginary part This completes 
the proof in the case where the iV-dimensional y{t) process has no deterministic 
factor. If there are such factors, it is easily verified that G(X) has corresponding 
discontinuities and the above proof then applies to G(X) less its jump function. 
The result can finally be summarized as in the statement of the theorem. If the 
y{t) process has only deterministic factors (Pv(f)]ii will be a sum of trigonometric 
functions and G(X) will be a function of jumps. 

Conversely suppose that the x(t) process has the complex spectral function 

(4.9.13) . Then following the ideas of the proof of the analogous section of 
Theorem 3.9, it follows that Rit) satisfies the differential equation (cf. (3.9.10) 
and (3.9.11)). 

(4.9.14) R^^\t) - a,R^”-^\t) - - • - a„R{t) = 0,1 > 0. 


Any solution of (4.9.14) is a linear combination of (at most N) functions 

(4.9.15) e^‘, te^\ ■ ■ ■ 


where (3 is a root of the equation 

(4.9.16) a"' - - • • - - Oy = 0 


and where powers of i may appear if /3 is a multiple root. Let e be a positive 
number. The discrete parameter process determined by the variables {®(ne)) 
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has correlation function Ii{nt). Tliis function is a linear combination of func¬ 
tion 

(4.9.160 (e'O", n(e^r. ■ ‘ 

corresponding to those of (4.9.15), There is an equation 

(4.9.17) ot^ — ai(«)a^''* _ ... _ ov(<) =“ 0 

with the (e*'*} as roots, of the same multiplicity as that of /9 in (4.9.16). Hence 

(4.9.18) ii:[(n + N)t] - aM(n + N - 1)A -- a„{,)It{ru) - 0, 

n g 0. 

According to Theorem 3.10 the 2;(7i.t) discrete parameter process is therefore 
a component process of an TV-dimensional discrete parameter th.G.M, process. 
Since this is true for all t, the x{t) process is a component process of an TV-dimen- 
sional continuous parameter t.h.G.M. process. 

If the integral vanishes identically, the non-deterministic factors in the TV- 
dimensional proce-ss are irrelevant to the x(i) process and can be replaced by 
factors of type TIT'(O). If on the other hand the specural function is continuous, 
the deterministic factors are irrelevant and can be replaced by factors of 
type M. 

Proof of («). Since the t.h.G.MAr processes are characterized among the 
component processes of TV-diraeneional t.h.G.M. processes by the fact that the 
first TV — 1 derived process exist, their spectral functions (according to Theorem 
1.4) are characterized by the property that 

£ dG(X) < « 

that is the numerator in (4.9.1) must be identically coirstant. If this constant 
is not 0, S(X) can have no jumps, since each jump corresponds to a aero of nu¬ 
merator and denominator. Hence G(X) is either identically S(X) or is in the 
form (4.9.2). The two possibilities obviously correspond to the deterministic 
and non-deterministic cases, respectively. 

Corollaby. TTie t.h.G.Mff. one dimensimal 'process which is the soliUton of 
(4.4.1) has complex spectral function 

(4.9.19) £ KfX)'^ - ai(i>0^-> - - o,l> • 

In fact the complex spectral function has the form (4.9.2), where the coeffi¬ 
cients in the polynomial are those of the differential equation for the correlation 
function Ey(t) in (4.9.9), that is the coefficients of the characteristic equation of 
the infinitesimal transition matrix Q, (cf. (4.4.8)). The evaluation (4,9.19) is 
also easily proved directly. 

The analogues of Theorems 3.10 and 3.11 in the continuous parameter case 
are easy to prove and will be omitted. 



ON CUMULATIVE SUMS OF RANDOM VARIABLES 

By Abraham Wald 
Columbia University 

1. Ii troduction. Let (aj} (i = 1,2, ■ ■ • , ad inf.) be a sequence of independent 
random variables each having the same distribution. Denote by Z, the sum 
of the first j elements of the sequence [Zi] , i.e., 

(1) Zj = zi + 22 +■■■ + z, 0 = 1. 2, •• • , adinf.). 

Let o be a given positive constant and h a given negative constant. Denote 
by n the smallest positive integer for which Zn lies outside the open interval (6, 
a), i.e., Z„ is either < b or > o. Obviously n is a random variable. Ifh < Zt < 
o for i = 1, 2, • • • , ad inf., we shall say that n = «>. 

For any relation R we shall denote the probabUity that R holds by P(i?). 
It will be shown later that P(n = « ) = 0, provided the variance of z* is positive, 

In this paper we shall deal with the problem of obtaining the value of P(Z„ > 
a)‘ and that of finding the probability dtetribution of n. 

The study of such cumulative sums is of interest in various statistical prob¬ 
lems. For example, a multiple sampling scheme proposed recently by Walter 
Bartky“ makes use of such cumulative sums. 

Cumulative sums also play an important role in the theory of the random 
walk of interest in physics. The results obtained in this paper may have bear¬ 
ing particularly on the theory of the random walk with absorbing barriers. In 
the presence of an absorbing wall the random walk stops whenever the particle 
arrives at the wall, i.e., whenever the cumulative sum of the displacements 
reaches a certain value.’ 

2. Two Lemmas. Lemma 1. If the variance of Zi is not zero, P{n = w) = 0. 

Proof: Let c = |fl|-|-|fe|. Iftt==o then for any positive integer r the 

following inequalities must hold 

( (i+l)r y 

E z.) < c' (fc = 0, 1,2, ••■,adinf.). 

,_tr+l / 

To prove P{n = oo) = 0, it is sufficient to show that the probability is zero that 
(2) holds for all integer values of k Since the variance of Z{ is not zero, the ex- 


1 Since P(n = *) = 0, we have P(Zn ^ &) = 1 — P(Z„ £ o) 

* ‘‘Multiple eampling with constant probability", Annals of Math. Stat , Vol. 14 (1943), 
pp. 363-377. 

> See in this connection S. Chandrasekhar, “Stochastic problems in physics and astron¬ 
omy”, Rev, of Modern Physics, Vol 15 (1943), p. 6 
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pected value of 2 { j converges to « as j —» «>. Hence there exists a positive 

integer r such that 

« p[(i:.)■<.]<:. 

From (3) it follows that the probability that (2) is fulfilled for all values of k is 
equal to zero. Hence P(n = «) = 0 and Lemma 1 is proved. 

Lemma 2. Let zbe a random variable such that the following four conditions are 
fulfilled: 

Condition 1. Both the expected value Ez of z and the variance of z exist and are 
unequod to zero. 

Condition 11. There exists a positive 5 such that P(e' < 1 — 6) > 0 and P(c' > 
1 + 5) > 0. 

Condition III, For any real value h the peeled value Pe*' = g{k) exists. 
Condition IV. The first two derivatives of the funelion g(h) exist and may be 
obtained by differentiation under the integral sign, i.e., 

g'ih) = ~Be^‘ - Eze'^, 

and 

g»{h) = —Ee'" « Pz'e*'. 

arr 

Then there exists one and only one real value ht 0 such that 

Ee'"“ = 1. 

Proof; For any positive h we have 
(4) 9ih) > Pie- > 1 + fi)(l + S)\ 

Hence, since P(e* > 1 + 5) >0, 

(6) lim g(h) = + w. 

Similarly we see that for any negative h 

(6) gQi) > P(e‘ < 1 - 5)(1 - S)\ 

Hence, since P(e* < 1 — 5) > 0, we have 

(7) lim gQi) = +», 

s—*• 

Since g"ih) = Pz“e*' it follows easily from Condition II that 

(8) g"ih) > 0, 
for all real values of h. 
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The relations (5), (7) and (8) imply that there exists exactly one real value 
h* for which g{h) takes its minimum value. Since ^'(0) = Ez is unequal to zero 
by Condition I, we see that h* 7 ^ 0 and g(h*) < 01(0) = 1. It is clear that the 
function g(h) is monotonically decreasing in the strict sense over the interval 
(— 00 , /i*), and is monotomcally increasing in the strict sense ov6r the interval 
(h*, + 00 ). Since 0(0) = 1 and g{h*) < 1, there exists exactly one real value 
ho 9 ^ 0 such that g{ho) = 1. Hence Lemma 2 is proved. 


3. A fundamental identity. Denote by z a random variable whose distribu¬ 
tion is equal to the common distribution of Zi{i = 1, 2, • ■ • , ad inf.). Let D' 
be the subset of the complex plane such that Ee“' = (p{t) exists and is finite for 
any point t in D' Consider the following identity 

(9) ^gZ„«+(ZAr-*.)i ^ 


where N denotes a positive integer. Let Pk be the probability that n < N, 
For any random variable u denote by Es{u) the conditional expected value of 
u under the restriction that n < N, and by E*{u) the conditional expected 
value of u under the restriction that n > N. Then identity (9) can be written as 

(10) -h (1 - PH)Ele^^‘ = 

Since m the subpopulation defined by any fixed n < E the expression Zs — 
Z„ 18 independent of Zn, we have 

(11) = £^*"'[^(0]""". 


From (10) and (11) we obtain the identity 

(12) P^E^le^^'l^iDf-”} -I- (1 - P,,)Ete^’'‘ = [^.(Or. 

Dividing both sides by [v(<)]^ "we obtain 


(13) 


P^EAe’^^im-"] + (1 - P>^) 




1 . 


Let D” be the subset of the complex plane m which | <p{t) | > 1 and denote by 
D the common part of the subsets D' and D". Since lim (1 — Pjy) = 0, 

and since | BlD(e*'^‘) j is a bounded function of N, we have in D 

P* _*Ar« 

(14) lim (1 - Py) = 0. 

Since 




lim PyEy{e^'‘[<p{t)r] = E{e*'‘[<p{tr^^, 


we obtain from (13) and (14) the fundamental identity 

(15) Eie^-UDD = 1, 

for any point t in the set D. 
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4. Derivation of the probability that Z„ > a. In what follows in this and the 
subsequent sections we shall always assume that the random variable z satisfies 
the conditions I-IV of Lemma 2, even if this is not stated explicitly. Since it 
follows from Condition III that the set D' is the whole complex plane, we see 
that,the identity (16) must hold for all points i for which [ vs(<) | > 1. 

Let be the real value for which ip{h) = 1 Substituting Ao for t in (15) 

we obtain 

(16) L'e*"** = 1. 

Let El be the conditional expected value of e*"** under the restriction that 
Z„ > a and let Ea be the conditional expected value of under the restriction 
that.Zn < b. Furthermore denote P(Z„ > a) by a. Then it follows from (16) 

(17) ctEi + (1 - a)Eo = 1. 

Hence 


(18) 


a 


1 — Et 

El -"Eo' 


If ho > 0 then Ei > I and L’g < 1. Hence (18) implies the inequality 


(19) 


<^< 

/Ifl 



{ho > 0 ). 


If Ao < 0 then Ei < 1 and Eg > 1. Hence (18) implies the inequality 

(20) (Ao<0). 


We shall now derive lower and upper limits for Eg and Ei. We derive these 
limitB under the assumption that /lo > 0. To obtain a lower limit of Eg consider 
a real variable f which is restricted to values > 1, For any random variable u 
and any relation R we shall denote by E(u | R) the conditional expected value 
of u under the restriction that R holds. Denote by P({') the probability that 
< fe**". Then we have 

(21) Eg = | e*"' < 

Hence a lower bound of Eg is given by 

(22) E'g - jg.l.b. m (e*** | e*»* ^ , 

where the symbol g.l.b. stands for greatest lower bound with respect to f. Since 
is an upper bound of Eg , we obtain the limits 

e^^'lg-Lb. fE(e’‘>’ | e**' < < Eg < 


(23) 


(Ao > 0). 
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Let p be a real ariable restricted to values > 0 and < 1. Denote by Q(p) 
the probability that Then similarly to (21) we obtain 

(24) E, = jpe"*' E 1 e'"' > dQ{p). 


Hence an upper bound of Ei is given by 


(25) 


e'^'H.u.b. pE 





> 



Since e“*’ is a lower bound of Ei , we obtain the following limits for Ei 


(26) 


..0*0 


< El < 


-0^0 


l.u.b. pE 


Ao* I 


> 



(fto > 0). 


In a similar way upper and lower limits can be derived for Eo and Ei when ho < 
0. With the help of these limits upper and lower limits for a can be derived on 
the basis of equation (18). If ho > 0 then Ei > 1, Eo < I and consequently 
the right hand side of (18) is a monotonically decreasing function of Et and Ei. 
Hence if E[ is a lower, and E{ is an upper bound of Et{i = 0, 1), then 


(27) 


1 - .Bo 


< 


w7 ^ 
ivi *” ^0 


1 - Bo 

jn* -pf * 
jDi “ Jha 


(ho > 0). 


In a similar way limits for a can be obtained when ho < 0. If both the absolute 
value of Ez and the variance of z are small, Bo and Bi will be nearly equal to 
and e“*“, respectively. Hence, in this case a good approximation to o is 
given by the expression 


(28) 


1 

g«*0 _ g**o • 


The difference a — a approaches zero if both the mean and standard deviation 
of z converge to zero. 


6 , The characteristic function of n. Let be a random variable defined as 
follows: = a if Z„ > o and = h ii Z„ < b. Denote the difference — Z„ 

by £. Then « is a random variable. 

In what follows we shall neglect e i.e., we shall substitute 0 for «. No error 
is committed by doing so m the special case when z can take only two values d 
and —d and the ratios a/d and h/d are integers, since in this case e is exactly zero. 
Apart from this special case the variate e will not be identical with the constant 
zero. However, the smaller the values j Ez | and Bz*, the smaller the error we 
commit by neglecting t. In fact, for arbitrary small positive numbers ii and dt 
the inequality p( 1 e | < 5i) > 1 — will hold if [ Bz | and Bz* are sufficiently 
smaU. Thus in the limiting case when Bz and Ez‘ approach zero the random 
variable t reduces to the constant zero. 
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(&). The characlerisiic function of n when only one of the quantUiee a and b is finite. 
It will be sufficient to treat the case when a is finite and ft — — «, In this case 
n is defined as the smallest positive integer for which > a. To make the 
probability of the existence of such a value n to be equal to 1 we have to assume 
that the expected value a of z is positive. Since b ~ — », the. fundamental 
identity (15) need not hold for all points t of the set I). However, it follows 
easily from (13) that (15) holds for all points I in I) whose real part is non-nega¬ 
tive. Denote by ^(r) the characteristic function of n (r is a purely imaginary 
variable), Since = n (neglecting <), and 

EMI)]"' - if'l- logse(/)l, 

identity (15) can be written as 

(29) log^(i)l = 1. 

Let t(r) denote a root (with non-negative real part) of the equation in t 

(30) log v>(i) + T = 0, 
and substitute t(r) for I in (29). Then we obtain 

(31) ^(r) - e-'''". 

As an illustration let us calculate ^(t) in the case when z is normally dis¬ 
tributed. In this case 

I 

log ifi(t) « + 2 ^*1 

where m is the mean and o- is the standard deviation of z, Hence 



If we take the -1- sign before t he square root sign, the real part of l(r) is non¬ 
negative, since the real part of Vm* “ 2«'*t is greater than or equal to ju. Hence 
the characteristic function of n is given by 

(33) Mr) = (g > 0). 

(b). The charactemiicfnndion of n when a and b both are finite. Given the value 
of n, let p„ be the conditional probability that = a. Let p* denote the prob¬ 
ability that n is the smallest positive integer for which either = a or = 5 
holds. Neglecting 2n ~ identity (16) can be written as 

(34) £ + (1 - pn)e‘'][<^(0]“"pt * 1. 

n«<l 

Let M{r) be the characteristic function of n in the subpopulation where = o, 
and let Mir) be the characteristic function of n in the subpopulation where = 
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b. Furthermore let ^(r) be the characteristic function of n in the total popu¬ 
lation. 

Since we neglect the difference — Z„ , it follows from (18) that the prob¬ 
ability a that = a is given by 


(35) 


1 - 6*’'“ 
g“*0 _ g>^0 ‘ 


Putting 1 — p„ = g„ the following relations hold 


(36) 

(37) 

(38) 


l/'i[-log v»(<)] = 




^2[-log v>«)] = ^ " 

2^5nP« 1 “ “ 

^[-logVj(<)J = YjV*{>pit)T” = (Pn + $«)[«’(<)]"" pt 

= tW'iI—log »>(<)] -h (1 — a)^ 2 [—log ¥>(<)]- 


Putting —log^(0 = r we obtain from (34), (36) and (37) 

(39) £i[^i(T)e“‘ 4- (1 — a)^s(T)e‘' = 1. 

According to Lemma 2 the equation —log ip{t) — 0 has two different real roots 
in t, < = 0 and i ■= h , and and ip'iho) both are unequal to zero. Hence, if 
ip{t) is not singular at f = 0 and t = ho, the equation 


— l0g¥>(t) = T, 

has two roots h(r) and <j(t) for sufficiently small values of r such that lim ii(T) 
= 0 and lim < 2 ( 1 -) = ho . Since the identity (15) holds for all values of t for 

r"0 

which I (p{t) I > 1, and since (<o[ii(T)] | = [ v[fe(r)] | = 1 for all imaginary values 
of T, it follows from (39) that both equations hold 

(39') «^i(T)e'-‘^‘'’ -b (1 - a)^2(r)e‘'‘'^' = 1, 

(39") r«^i(r)e“‘*<'> 4- (1 - a)^2(r)e'“''' = 1. 

Solving these two linear equations we obtain ^i(t) and \ 1 'j(t). The character¬ 
istic function ^(r) is given by 


^(r) = cii^i(t) 4- (1 — “)^i(r). 


As an illustration we shall determine ^i(t), ^(r) and ^(t) when z has a normal 
distribution with mean fi and standard deviation tr. We have 

2 

—log <p{t) ~ —id — ^ 


= T. 
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Hence 

(40) t = 

Putting e" = A and c'’ = B we obtain from (39) and (40) 

(41) + (i _ «)^i(r)^ 1 

(42) rvt'i(T)i4-»‘'»’-i^>vSi-**T + (1 ~ ^ 

These two equations are valid for any imaginary value of 7 . Since h = 
we obtain from ( 35 ) ^ 


(43) 

1 _ 

/Y 

Let 


(44) 

9i “ ^ - 2(7^7, 

and 



Then we obtain from (41) and (42) 


(46) 

and 


04/1(7) 


B’> ~ B’' 
A*'B“ - A'’J5'‘ ’ 


(47) 


(1 — a!)^i(r) 


— A“B’'' 

Hence the characteristic function of n is given by 

A'l ^ _ gfi 


(48) 


4/{t) = 


A'*B'* — A"’ B’* 


a distributed, (a) The caee when 

by ( 3 ^ ~ characteristic function of n is given 


(49) 


m 



n. 


Then the characteristic function of m is given by 
(50) ^ c.(i-VT:71 ^ 
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where 




The distribution of m is given by 


-i. 

2irt jL,„ 




G{c, m) = r dt, 

h «Lr>taO 




we have 


1 d —c-y/l—i—mf 

2iri 


“ 2x4 ( 2^1 - t ”‘) 


<\/l— 


I H(c, m) - mG{c, m) = ^ = 0. 


From (53) and (54) we obtain 

dH(c, m) 


+ G(c, m) = 0. 


From (56) and (57) it follows that 


~ H{c, m) +m -—— = 0. 


Hence 


(59) log H{c, m) = — — + log \(m) 

where X(m) is some function of m only. Thus 

(60) H(c, m) = X(»n)e~°’'‘’" 

Now we shall determine X(m). We have 




(61) 
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Since (1 — 0 is the characterietic function of where x has the x’-distribu- 
tion with one degree of freedom, the right hand side of (61) is equal to 

1 -« 

■ 

Hence 

(62) 

From (60) and (61) we obtain 

(63) 

From (56) and (63) we obtain 

(64) 

Hence the distribution of m is given bj' 


( 66 ) 




dm, 


(0 < m < »). 


Let m = - m*. Then the distribution of nt* is given by 
2 


D(rn*) dm* 


c?/2 


( 66 ) 




ffi ^ 

*^»/i 




dm* 


_ Vc 

v^im*f'' 


--(c/W U/m«+m»-J) 


dm*. 


The function —- m* — 2 is non-negative and is equal to ssero only when m* = 1. 


m 


If c is large, then D(m*) is exceedingly small for values of m* not close to 1. 
Expanding m* — 2 in a Taylor series around m* = 1, we obtain 


(«) 

Hence for large c 
( 68 ) 


-f- m"" — 2 = (m* — 1)“ ■+• higher order terms. 
m 


Dim*) dm* g-W8)(«--n» 

•V2t 


i.e., if c is large m* is nearly normally distributed with mean equal to 1 and 

standard deviation ~7^. 

Vc 
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(b). The case when a and b both are fimte. In this case the characteristic function 
of n is given by (48). Let 




and 


d= 


Then the characteristic function of m is given by 

,4*1 4 , B*j _ ^*1 _ 


(69) 

where 

(70) 






h = d{l - VT^t), hi = dH + y/l ~ t), 


and t is an imaginary variable. Putting = A, = E, da = a and db =s 6, 
the characteristic function of m can be written as 


(71) 


^ - giVr:!) -f 5(et\/n:t - e-Sy/w) 

AS(e^^^^'''^^ — g(a-J)v7^j 


_ ^ e( 2 a-S)VPi) 4 . 5(e“v^ — e(5-2S)\/w) 

AS(1 - e2(«-5)vT:<) ’ 

It will be sufficient to consider only the case when ti > 0, since the case < 0 can 
be tr eated in a similar way. Then a < 0 and 6 > 0, Since the real part of 
d-Vl — i is greater than or equal to one, we have 

(72) 

for any imaginary value of t. 

(73) 

Then 

(74) 


I en5-6)Vw ] < 
Let 

y _ g2(s— 


r-^ = Er. 

1 — J i-O 


From (71) and (74) it follows that ^*(t) can be written in the form of an infinite 
series. 


(75) 


^*(0 = 


where X,- and r, are constants and X, > 0. Each term of this series is a character¬ 
istic function of the form given in (50) except for a proportionality factor. Let 
F,(m) be the distribution of m corresponding to the characteristic function 
Then Fi(m) can be obtained from (66) by substituting Xi for c. Since 
we may integrate the right hand side member of (75) term by term, the dis¬ 
tribution of m IS given by 


(76) 


F(m) dm = ^ Ft{m)^ dm. 
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Since w is a discrete variable, it may seem paradoxical that we obtained a 
probability density function for m. However, tlie explanation lie's in the fact 
that we neglected e = — iTn and this quantity is zero only in the limiting case 

when n and <r approach zero. 

If I a I and a are sufficiently small as compared with a and j 6 | , the distnbu- 
tion of m given in (70) will be a good approximation to the exact distribution of 

m, even if z is not normally distributed. The reason for this can be indicated 
as follows: Let 

tr 

(77) z* = 22 (t = 1,2, ■ • • , ad inf.) 

/-(i-Or-H 

where r is a given positive integer. Since the variates 2 / are independently dis¬ 
tributed each having the same distribution, under some weak conditions the 
variates 2^(1 = 1, 2, ■ • • , ad inf.) will be nearly normally distributed for large r. 
Hence, considering the cumulative sums — z* + zi, -f- ■ ■ ■ -f- z? (t = 1, 2, ■ • • , 
ad inf.), the distribution given in (76) is applicable witlv good approximation, 
provided that r | n | and •\/r<r are small as compared w'ith 0 and ) h | so that the 
difference e* = can be neglected. 

7. The exact probability distribution of Z„ and the exact characteristic func¬ 
tion of n when z can take only integral multiples of a given constant d. In the 
previous sections we derived tlie probability P(Jf„ > a) and the characteristic 
function of n under the aasurnption that the quantity by which may differ 
from 0 or li is small and can be neglected. This can lie done whenever | Fz | 
and 7?z“ are small, However, if | Ez | or JiV is not small, it Ls desirable to derive 
the exact probability distribution of and the exact characterLstic function of 

n. Both aic obtained in the present .section for random variables z which can 
take only a finite number of integral multiples of a given constant d. This is a 
rather general result, since any distribution of 2 can be approximated arbitrarily 
fine by a discrete distribution of tlie above tyjM? if the coastant d is chosen suf¬ 
ficiently small. 

There is no loss of generality in assuming that d = 1, since the quantity d 
can be chosen as the unit of measurement. Thus, we shall assume that 2 takes 
only a finite number of integral values. Let gi and p* be two positive integers 
such that P(z ^ ~gi) and P{z — P 2 ) are positive and z can take only integral 
values > —Qi and < g% . Denote P(z = i) by /i,, Then the characteristic 
function of z is given by 

(78) vid) « 2 

«i 

To obtain the roots of the equation v(0 = 1, we put e‘ = u and solve the equa^ 
tion 

£ ktu^ => 1. 

ffl 


(79) 
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Denote gi + by g and let the g roots of (79) be Ui, ■ ■ • , Ug, respectively. We 
shall assume that no two roots are equal, i.e., w, Uj for i j. Substituting 
u, for e‘ in the identity (15) we obtain 

(80) £(«f-) = 1 

Denote by [a] the smallest integer > a, and by [b] the largest integer < h. Then 
Zn can take only the values 

(81) [b] — gi + 1, [b] — pi + 2, • • • , [b], [o], [a] + 1, ■ • • , [o] + ga — 1. 

Denote the g different integers in (81) by Ci c, , respectively. Further¬ 

more, denote P(Z» = c.) by . Then equations (80) can be written as 

(82) £ iynt' = 1 (f = 1, • • ■ , ^)- 

j-i 

Let A be the determinant value of the matrix || || (i, j = 1, • • ■ , g) and let 

A, be the determinant we obtain from A by substituting 1 for the elements in 
the gth column. If A 0, it follows from (82) that P(2„ = c,) = f,‘is given by 


(83) = 

Hence, P(Z„ > a) = (^i/A) summed for all values of j for which Cj > a, 

) 

From the probability distribution of Zn we can easily derive the expected value 
En of n. In fact, differentiating the fundamental identity (16) with respect to 
i at < = 0 we obtain 


(84) 


Since 


P^(0) 

^(0) 


(85) 


E 




= 0 . 


Ez, we obtain from (84) 



Ezfli A ■ 


Now we shall derive the exact characteristic function of n. Denote by 
(r is a purely imaginary variable) the characteristic function of the condi¬ 
tional distribution of n under the restriction that = Cj. Let h(’')» “' > 
be g roots of the equation 


(86) 

<p{t) = e^, 

such that 


(87) 

lim = u. 


T>-0 


Substituting U{t) for t in the fundamental identity (15) we obtain 

(88) E fye*''‘‘'V,(T) = 1 

)-i 


(t = 1, • ■ •, g). 
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(89) 


S(t) = 


the unknowns ‘ 

given by 


fie"''*'"’ ■ • • 


fic""*'"’ ■ - • 


fie'i*''"’ ... 



^j(t) and the deter- 


Obviously, 5(0) = {jfi ■ ■ ■ fjA. Hence if f,- 0 (i = 1, • • * , g) and A pi 0, 

also 5(0) p^ 0 and consequently 5(t) pi 0 for any r with sufficiently small absolute 
value. Thus, ^i(t), • ■ • , ^,(t) can be obtained by solving the linear equations 
(88). The characteristic function ^(r) of the unconditional distribution of n 
is given by 

( 90 ) Hr) MM- 




SOME IMPROVEMENTS IN WEIGHING AND OTHER EXPERIMENTAL 

TECHNIQUES' 

By Habold Hotelling 
Cdlumbia University 

When several quantities are to be ascertained there is frequently an oppor¬ 
tunity to increase the accuracy and reduce the cost by combining suitably m one 
experiment what might ordinarily be considered separate operations. The 
theory of design of experiments developed as a branch of modern mathematical 
statistics, and of which fundamental considerations are set forth m R. A. Fisher’s 
book [1], provides many improvements of this kind. Since the main interests 
of Fisher and other originators of this theory have been in biology, the applica¬ 
tions so far made have been chiefly biological in character, excepting for certain 
economic and social investigations involving stratified sampling. The possi¬ 
bilities of improvement of physical and chemical investigations through designed 
experiments based on the theory of statistical inference have scarcely begun to 
be explored. 

The following example is due to F. Yates [2]. A chemist has seven light ob¬ 
jects to weigh, and the scale also requires a zero correction, so that eight weigh¬ 
ings are necessary. The standard error of each weighing is denoted by c, the 
variance therefore by Since the weight assigned to each object by customary 
techniques is the difference between the reading of the scale when carrying that 
object and when empty, the variance of the assigned weight is 2/, and its stand¬ 
ard error is <r \/2. 

The improved technique suggested by Yates consists of weighing all seven 
objects together, and also weighing them in groups of three so chosen that each 
object is weighed four times altogether, twice with any other object and twice 
without it. Calling the readings from the scale 3 /i, • ■ ■ , i/s we then have as 
equations for determining the unknown weights a, b, • ■ , g, 

a + h + c + d + e + f + g = yi 
a + b + c = Vi 

a + d-\- e = 2/3 

a + / + 9 = 1/4 

b + d + f = Vi 
h + e + g = y» 

c + d + g = yi 

c -f e -b / = 2/s. 

‘ Presented at the Wellesley meeting of the Institute of Mathematical Statistice, Aug. 
la, 1944. 
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Any particular ■weight is found by adding together the four equatione containing 
it, subtracting the other four, and dmding by 4. Thus 

+ Vi + 1/j + yi - ys - i/» - 2/r - y» 

a = . -- — - . 

The variance of a sum of independent observations is the sum of their variances, 
as is well known, and the variance of c times an observation is c’ times the 
variance of that observation. Taking c = J for the first four terms in the expres¬ 
sion for a and e = — i for the others gives for the variance of a by this method 
//2, which is only one-fourth that for the direct method. The standard error, 
or probable error, has been halved. If a degree of accuracy is required calling 
for repetition a certain number of times of the weighings by the direct method, 
then only one-fourth as many weighings are needed by Yates' method to procure 
the same accuracy in the average. 

A further improvement, which does not seem to have been mentioned in the 
literature, will be obtained if Yates' procedure is modified by placing in the other 
pan of the scale those of the objects not included in one of his weighings. Calling 
the readings in this case zi, ■ • • , , we have 

a -j- b c -j- d “b ^ "ri* f d" Q ~ Zl 

a + b + c- d- e- f- g = Z7 
a — b — c-|-dH-a — / — 
a — b — c — d — e + f + g>=Zi 
—a -|-b — c-|-d — 6-f/ — (/»z( 

-a-jrb — c — d-\~e — f+g^zt 
-a—b + c + d~e — f + g^z^ 

— a — b + c — d-{-e-{-f—g=‘Zt, 

From these equations, 

a = + ^ + ^ + 

with a like expression for each of the other unknowns. The variance of each 
unknown by this method is <r^/S. The standard error is half that by Yates' 
method, or a quarter of its value by the direct method of weighing each object 
separately. The number of repetitions required to procure a particular standard 
error in the mean is one-sixteenth that by the direct method. 

A simpler example illustrating the same point is that of two objects to be 
weighed, with a scale already corrected for bias, Again let v be the variance 
of an individual weighing, If we weigh the two objects together in one pan of 
the scale, and then in opposite pans, we have as equations for the unknown 
weights o and b, 


0 d- b = Zl, 


o — b = zj, 
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whence 

a = (zi + Zs)/2, 6 = (zi - zj)/2. 

The variances of a and b by this method are both equal to a^/2, half the value 
when the two objects are weighed separately. The means found from a number 
of pairs of weighings of sums and differences have the same precision as those 
found from twice as many pairs of w e i g hings of the objects separately. 

Further economies of effort, or gains in accuracy, are possible with larger 
numbers of weighings and of objects to be weighed. These improvements can 
to some extent be applied also to other types of measurement, as of distances, 
since it is sometimes possible to measure the sum of a number of such quantities, 
or the difference between two such sums, with approximately the same accuracy 
as a single one of them. The outstanding case, however, seems to be that of 
weighing on a balance objects light enough so that their aggregate weight is 
below the maximum for which the balance was designed, since in this case it is 
quite reasonable to assume that the several recorded results all have the same 
standard error c and that they are independent. 

In what follows, some principles underlying the design of efficient schemes of 
this kind will be developed and applied to obtain some additional plans. How¬ 
ever no comprehensive general solution has been reached; this appears to be a 
matter for further mathematical research. Also, we leave aside in this paper 
the problem of estimating the error variance. All this discussion is based on 
the minimization of the actual variance. In order to utilize the results it is 
necessary that this variance be either known a priori or estimated from the 
residuals from the least-square solution. The latter type of estimate is in some 
ways more satisfactory, since it refers to the actual experiment rather than to 
some previous experiments which may not have been made under exactly the 
same conditions. But in order to have such an estimate it is necessary that the 
number of observations exceed the number of unknowns, and desirable that the 
excess shall have a large enough value to insure a stable estimate of the error 
variance a*. The appropriate test for significance, or determination of confidence 
limits for the unknowns, must then utilize the Student distribution or its general¬ 
ization, the variance ratio distribution, which take full account of the instability 
caused by an inadequate number of degrees of freedom for estimating tr. 

It is only when cr is known exactly apart from the experiment being designed 
that the criteria we here consider are exactly applicable. In other cases there 
may need to be a balancing, in the design of the experiment, between the de¬ 
siderata of minimum variance and of accurately known variance, with the accu¬ 
racy of this knowledge depending on the number of available degrees of freedom. 
A theory of design taking full account of this consideration would require a use 
of the power functions of the Student distribution and the variance ratio dis¬ 
tribution, discovered respectively by R. A. Fisher [3] and P. C. Tang [4]. 

We shall denote by N the number of weighings to be made, and by p the num¬ 
ber of objects to be weighed. In order that it be possible to determine the un- 
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known weights from the obhervation-s it is necessary that p g iV, and if a possible 
biaa in the scale must he eliminated by means of the same data it is necessary 
that p ^ N — 1, Ruppasing th(>sc conditions to he satisfied, we shall show, 
among other things, that the minimum possible variance for one of the un¬ 
knowns is that the experiment may lie arranged so that a selected one of 
the unknowns has exactly this minimum variance excepting when A'' is odd and 
a bias must he allowed for also; and that for some, liut not all, combinations of 
p and N, this minimum variance is attained for all the unknowns simultaneously. 
This minimum value a/N is of course cciual to tlie variance of the mean of N 
weighings of one object alone, disregarding the rest; but it will be seen below 
that by complex experiments of the kind indicated, determinations from the 
same number of weighings of the other weights also can at the same time be 
made with some finite variance, which may or may not have the minimum value. 

The following notation will be used in the proof. Let x,a = 1 or — 1 if the 
fth object is included in the ath weighing by being placed respectively in the 
left- or right-hand pan, and let Xia = 0 if the ith object is not included in the ath 
weighing. Here i = 1, 2, • • • , p and « = 1, • • • , A^, Ijct be the result 
recorded for the ath weighing, let A* be the error in this result, and let hi be the 
true weight of the fth object, so that we have the H equations 

(1) Ila&l d* -|- • • • + Xpahp = 2/o + Aa , 

provided there is no biaa, or if by pa wo mean the oliscrved weight corrected for 
a bias known a priori. Under these conditions the estimate of each of the bi’s 
having the properties of zero bias and minimum variance is that provided by 
the method of least squares. This statement, which does not depend on any 
assumption of a normal or other particular form of distribution of the errors, 
has been known long but not widely, since there is an easier derivation of the 
method by the application to the normal distribution to the method of maximum 
likelihood. Its proof, due originally to Laplace, has appeared in many forms 
in the work of Gauss and later authors [5]; the latest version is by the present 
writer [6]. 

Letting S stand for summation over all the N weighings we put 

(2) fli'y SxiaXja , Qi ~ Sxiapa , 
and write the normal equations in the form 


2a,= gi , 

where 2 stands for a sum with respect to j from 1 to p, From the usual theory 
of least squares (of. for example the reference last cited) it is known that the 
standard error of the determination of hi from these equations—which is the 
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minimuin possible standard error of by for any way of combining the observa¬ 
tions—is ff times the square root of Aw/A, where 



ttll 

Oi2 • • ■ 


Oil 

022 *• • 

fl2p 

api 

Uja — 

CEpp 


and All is the minor of A obtained by deleting the first row and column. 

The matrices of A and of An are known to be positive definite or semi-definite. 
The semi-definite case is excluded by the consideration that the normal equa¬ 
tions shall actually determine the unknowns. Hence the inverse of the latter 

But this inverse, which we may write 

) 

dpp _ 

consists of the coefficients in the identity 


matrix exists and is positive definite. 

^22 


d = 


'ipi 


AjAw = Oil — 2 d{,a{ia,i. 

..j-Z 


which is obtained oy expanding A with reference to its first row and first column. 
The positive definite character of d therefore leads to the following 

Lemma: If au ,•••, aip (— (hi a^i respectively) are free to vary while the 
other elements of A remain fixed, the maximum value of A/An is an , and is attained 
when and only when Ou = ou = • • • = ajp = 0. 

From this it is evident that the variance of bi, namely o'An/A, cannot be less 
than ff/an , and will reach this value only if the experiment is so arranged that 
the elements after the first in first row and column of A are all zero. That 
such an arrangement is possible may be seen by a consideration of the matrix 


■ a;u 3121 • 

H 

_1 

xn • • 

■ Xjj/^ 

• • 

• • • 

_ Xifr • 

« • 

• XpK. 


whose elements are restricted to be I’s, — I’s and O’s. The condition a.i = 0, 
by (2), means simply that Sx^Xia = 0, a condition which may be expressed by 
saying that the first column of X is orthogonal to the ith column. The condi¬ 
tion that the variance of bi have its minimum value a^/an is thus, according to 
the lemma, that the first column of X shall be orthogonal to all the others. The 
minimum minimorum of this variance will be reached if the first row of X is 
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not only orthogonal to all the others, but consists entirely of I’s and — Ts, so 
that On = N. The value of this minimuni minimoruin is a^/N. 

If there is a possible bias bo this procedure neetls to be modified by the addition 
of ibo to the left member of (1) and subsequent treatment of this tenn like the 
others, putting aioa = 1 in (2), and modifying X by adjoining a column of I's. 
The necessary and sufficient condition that the variance of b\ shall equal a’^/N 
is then that the column 


aiu 

Xu 

Xiif 

shall consist entirely of Ta and — Ts and shall be orthogonal to a column con- 
sistmg of I’s, and to all the other columns of X, 

If no bias needs to be eliminated the experiment can be arranged so that the 
variance of bj is a'^/N merely by filling up the first column of X with I's and 
—I’s in any arbitrary manner, and then choosing the later columns so as to be 
orthogonal to this first one, and so that all are linearly independent. This can 
be accomplished, for example by choosing the first element in all the columns to 
be the same as that in the first column; choosing the ith element in the tth column 
(i = 2, 3, • • • , p) to be the negative of the tth element in the first column; and 
making all the other elements of X zero. 

When a bias is to be eliminated, so that there is a column of I’s in X corre¬ 
sponding to bo, it is necessary that N be even in order that the column of X 
corresponding to bi may consist of I's and —I's in equal numbers, without any 
O’s, a condition essential for the orthogonality between these two columns with 
the maximum value N for Ou . Supposing N even, let us assign the value 1 .to 
each of the first N/2 elements of the column corresponding to bj and the value 
-1 to the last N/2 elements of this row. The remaining rows of X may then 
be filled up by the same method as that indicated above for the case in which 
there is no bias. The variance of 6i will then take its theoretical minimum 
value a^/N, 

If N is odd and there is a possible bias, the column of X corresponding to bi 
can be filled up with I’s and —I's In equal numbers, with a single zero, and the 
remaining columns can be made orthogonal to it. The variance of bi in this 
case will be tr’/fiV — 1), 

The method suggested above for filling up the later columns of X is convenient 
for the proof, but is not usually to be recommended in practice, since other 
methods will in all but the simplest cases give smaller standard errors for the 
unknowns other than the first. For some values of N and p it is possible to 
determine all the unknowns with equal and minimum variance. These are the 
cases in which all the columns of X can be made mutually orthogonal and 
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without zeros, excepting that the column corresponding to bo may contain some 
zeros. Thus for iV = 4 the scheme of weighing represented by the matrix 

ri 1 1 



1 - 1-1 1 


whose columns are all mutually orthogonal, may be applied to weigh three ob¬ 
jects when there is a possible bias, or four where there is not, with variance 
(r°/4 for each of the unknowns in either case. The matrix X'X of the normal 
equations has the form 

“4 0 0 0“ 

0 4 0 0. 

0 0 4 0 
.0 0 0 4_ 

Calling the results of the weighings yo,yi,yi, y> in the case of possible bias we 
have for the unknowns the expressions 

bi = (yo + yi ~ yt - j/j)/4 
h* = (j/o - i/i 4- ya “ y»)/4: 
b) = {yo - yi ~ yi + yi)/i. 

The complete orthogonality exemplified by this design has several advantages 
besides the fact that the variance of each of the unknowns has the same mini¬ 
mum value as if all the weighings were to be devoted to it alone (or half the value 
of the variance of this unknown if half the weighings were devoted to it plus 
bias and half to determining the bias). The diagonal form of the matrix X'X 
means that the labor of solving normal equations, which is sometimes formidable, 
is reduced to the trivial task of dividing by N. Also, the diagonal form of this 
matrix implies that its inverse is also of diagonal form, from which it follows 
that the estimates of the different unknowns are statistically independent. Con¬ 
sequently the variances, or standard errors, of linear functions of the unknowns 
are easy to find. Thus the variance of the difference between the estimates of 
two of the weights is simply the sum of their variances. But of course if the 
main object of the experiment is to determine a particular difference of this 
kind, or any other linear function of the weights, a different design should be 
sought to minimize the particular variance which is of interest. 

In contrast to the satisfactory design possible with four weighings, no complete 
orthogonality is possible with six weighings, or with any odd number, if the 
number of objects to be weighed is the maximum possible for the number of 
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weighings and ii eacli object is actually to enter into each weighing in one pan 
or the other. For iV = 3 and bias known to be zero consider the scheme 


X = 


1 

1 

1 


1 

-1 

0 


which corresponds to weighing two objects, first together in one pan, then in 
opposite pans, and then weighing one alone. Calling hi the weight of the object 
that has been on the scale through all three weighings and ha the other we have 
the estimates 


hi = ivi + ya + y!)/3 
ha = (yi - ya)/2, 


with respective variances 




= crVa, 


ffa = (T /2. 


Thus the first weight is determined with the minimum possible variance but the 
second is not. 

An alternative method of weighing under these same conditions is to weigh 
both objects in one pan together twice and to weigh them in opposite pans once. 
This gives 


with the normal equations 




t 


3hi + ha = yi + ya + y, 
hi + 3ha = yi + y, - y,, 

whose solution is 

hi = (yi + yi + 2yj)/4 
hi = (yi + yi - 2y,)/4, 

and variances 


a _ a 3 i 
<ri “* era = fv . 

Thus the weights are by this method determined with equal accuracy, which is 
better than by the preceding method for one of the objects but worse for the 
other. To choose between the two methods it is therefore appropriate to take 
into consideration the relative accuracy desired in the weights of the two objects. 
Either method is better than weighing the objects separately. 

Either of these two X matrices can also be made the basis for weighing a single 
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object when the scale is suspected of having a bias. The weight of this object 
will be estimated as 62 , and will have the variance by the first method, or 
|<r“ by the second. Thus the second method is distinctly superior in this case. 

Orthogonality between columns obviously requires both negative and positive 
signs, corresponding to weighings in both pans of the balance. Thus the ex¬ 
perimental designs of maximum efficiency for weighing on a balance are not 
available with a spring scale, or in making measurements of any kind in which 
it is not possible to arrange that the quantities read off are differences. In such 
cases the elements of X are restricted to be 1 or 0. Let us now consider some of 
the simplest cases of this kind, assuming for simplicity that ir = 1. We shall 
deal only with cases in which there is no bias. 

For IV = 3 , p = 2 the simple experiment of weighing one object twice and the 
other once yields variances j and 1 respectively. All other designs are in this 
case less satisfactory, with the possible exception of that specified by 


X = 


1 

1 

0 


1 

0 

1 


with bi = (yi -b - 1 / 3 )/3 and ( 2/1 - 3/2 -f 2ys)/3 having each the vari- 
ance of f. 

For W = 3, p = 3 the most efficient design is given by 


X = 


1 1 
1 0 
0 1 


0 

1 

1 


with 61 = (j/i + yi — ys)/2, and bi and b, given by cyclic permutation in this 
formula. The variance of each unknown is |. 

For iV = 4, p = 3 a design having an advantage in some situations is that 
given by 

0 1 " 

1 0 
1 1 
1 1 . 

(together of course with those obtained by permutations of rows and of columns, 
as is to be understood throughout). The normal equations are 



36i -|- 21)2 -}- 26j — y\ yt Vi 


2bi -j- 3bi -j- 2bs = yi Vh Vi 

2bi -b 21)2 -b 35* == Pi + p* + y*. 

An expeditious method of solution in this as in many similar cases is to add them 
all together and then subtract an appropriate multiple of the sum from each 
of the normal equations in turn. The variance of each unknown found by this 
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experiment ifl 6/7 = .714. Tlie Himi)le experiment coiiaiating of weighing one of 
the objects twice and the others once each yields variances in one case larger 
and in two cases smaller than this, 

For iV = p = 4 the cyclic arrangement 

’1110" 

110 1 
10 11 
.0 111. 

leads to variances all equal to 7/9. 

For ^ = 5, p = 2 the moat efficient design appears to be 

"1 O' 

0 1 
1 1 
1 1 
.1 I 

The variance of each unknown is in this case 1/3. 
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ON THE ANALYSIS OF A CERTAIN SIX-BY-SIX FOUR-GROUP 

LATTICE DESIGN! 

By Boyd Harshbahqer* 

Virginia Agriculiural Experiment Station 

1, Introduction. The lattice consists of groups of randomized incomplete 
blocks with certain restrictions being imposed on the randomization within eacL 
group, and the number of varieties is a perfect square. For example, if the num¬ 
ber of varieties is = 36, then the orthogonal groups for a triple lattice, not 
considering randomizing within the blocks or between blocks, are as follows; 
(the numbers signify varieties). 


GROUP X GROUP Y 


Blocks 







Blocks 




(1) 

1 

2 3 

4 

5 

6 


(1) 

1 

7 

13 19 

25 

31 

(2) 

7 

8 9 

10 

11 

12 


(2) 

2 

8 

14 20 

26 

32 

(3) 

13 

14 15 

16 

17 

18 


(3) 

3 

9 

15 21 

27 

33 

(4) 

19 

20 21 

22 

23 

24 


(4) 

4 

10 

16 22 

28 

34 

(5) 

25 

26 27 

28 

29 

30 


(6) 

5 

11 

17 23 

29 

35 

(6) 

31 

32 33 

34 

35 

36 


(6) 

6 

12 

18 24 

30 

36 






GROUP Z 








Blocks 













(1) 

1 


8 

15 

22 


29 

36 





(2) 

2 


9 

16 

23 


30 

31 





(3) 

3 


10 

17 

24 


25 

32 





(4) 

4 


11 

18 

19 


26 

33 





(5) 

5 


12 

13 

20 


27 

34 





(6) 

6 


7 

14 

21 


28 

35 



This design 

is constructed 

so 

that no variety 

appears 

with another variety 


more than once in the same block. This important characteristic makes the 
analysis simple, as it enables the results to be treated as a factorial design. The 
analysis is well described by Yates [3, 4, 5] and Cochran [1]. 

Suppose another group, U, is now formed from a six by six lattice, for example, 
the following group: 


> Certain of the ideas presented here are embodied in the author’s unpublished doctoral 
thesis by the same title, Library, George Washington University, Washington, D C., 1943. 

’ The author wishes to express his appreciation to W. G Cochran of Iowa State College, 
who advised freely in the preparation of the original thesis, and to Frank M. Weida of 
George Washington University. 
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GROUP U 


Blocks 


(1) 

31 

26 

21 

16 

11 

6 

(2) 

1 

32 

27 

22 

17 

12 

(3) 

7 

2 

33 

28 

23 

18 

(4) 

13 

8 

3 

34 

29 

24 

(6) 

19 

14 

9 

4 

35 

30 

(6) 

25 

20 

16 

10 

6 

36 


The important characteristic, that no variety appears with another variety in 
the same block more than once, does not hold. For example, varieties 1 and 22 
appear together in both groups Z and U. 

It is the purpose of this paper to develop the statistical method for the analysis 
of such a design, where each group la duplicated, and to apply the results to an 
actual problem. The least square solution, as developed here, uses only the 
intra-block information to correct the varieties for block effects. In a second 
article the solution using both intra- and inter-block information will be given. 


2. Estiination of the block and varietal effects. It is reasonable to assume 
in varietal trials that the general mean, and any particular block and variety 
effects, operate additively to produce the true mean of y associated with this 
block and variety. In particular, if y,,/is the yield of the plot for the;th variety 
in the ith block of the eth replicate,the following hypothesis may be set up, 
namely: 


( 1 ) 


l/»j = + P. + /3.t + -f- «.<j. 


Where p is the true or population mean yield, p, is the population replicate effect 
of the eth replicate, is the population block effect of the ith. block in the eth 
replicate, vjia the population variety effect of the jth variety, and is the ex¬ 
perimental error of the eij plot. Since the design has eight replicates, that is, 
each group is duplicated, the block effects may be estimated from unpaired and 
paired replicates or partners. 

It is assumed that the („j are independently and normally distributed with 

common variance ~ . Without loss of generality, it also may be assumed that 

the sum of the replicate effects, the sum of the block effects within any replica¬ 
tion, and the sum of the variety effects are respectively equal to zero. 

The parameters are estimated by the method of least squares, subject to the 
restrictions stated in the preceding paragraph, This involves choosing the 
parameters so that 


iS 


( 2 ) 


(v.n - 


mxi — r,X2, — 


b.< - b'.v 




b,i -h Ki 






8 8 8 . ,/ 8 « I, I 1,' *• 

+ X. £ r. + £ X,. L + S X.. E + X-2 V, 


2 


2 
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is a minimum.® Here y^ij is the dependent variate, and Xi, • ■ , are the 
independent variates. In ordinary regression problems, the values of the x 
variates, as well as the y variate, constitute a part of the original data. How¬ 
ever, in this case the y variate only is given, and the x variates must be con¬ 
structed. Thus, for the design, one takes a:i = 1 for all values; Xi, = 1 for all 
values in replicate e, but zero elsewhere; 2 : 3 ,, = 1 for all values in the zth block 
of the eth replicate and —1 for all values in its partner, but zero elsewhere; 
xui = 1 for all values in the tth block of the eth replicate and also 1 in its partner, 
but zero elsewhere, and xt, = 1 where variety j occurs, but zero elsewhere. 

One now takes the partial derivatives of the above equation with respect to 
the parameters and forms the normal equations. It can be shown that 
(Xi, ■ ■ • , X4) are each zero. The normal equations not involving X’s are: 

Nm + k^'tr. + 2ki:'t 

a 6 t t i' 36 

+ 2fcEE^-^-^‘ + 8E7y = G. 

6 36 

ki Tfi -I- -4- fc E b.j Vi = R,, 

.-I ,-i 

kir, - r',) -f 2k = B„ - S;,. 

Equations having —- as leading terms. 

4U 

Equations having v,- as leading terms. 


Leading term 


m 


(3) 


r. 


- bii 


In the above, N is the total number of values, k is the number of plots in a 
block, r* is the eth replicate effect, b„ is the ith block effect in the eth replicate, 
Vj is the jth variety effect, G is the total sum of all values, E, is the sum of the 
values in the eth replicate, is the sum of values in the tth block of the eth 
replicate and v, is the sum of the yields of the jth variety. The primes denote 
similar values of the partner terms. 

Using the restrictions 


(4) 


Er. = ZE 

«-l a-1 ^-1 


bii b,{ 


= EE 


b., - b'ei 


= E = 0, 


i-i 


the values of the following parametera are directly obtainable: 


( 6 ) 



r. 


E, G j — b'„ B,i — B',i 

P“S -2i— 



• S, for summation, will be used to represent summation over all values. 2 will be used 
in a more restricted sense. 
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The values of the 


&«i + 


and V, effects cannot be obtained directly. In 


order to simplify the solution of these etiuations, only the mean, confounded 
blocks, and the varietal effects will be used. The results later will be corrected 
for replicate effects. If each of the yields is added to the corresponding yield 
in its partner, one gets an equation of the form 


(6) 2/i* = + r* + 

where n, P,, and n are now twice their original valucjs. These parameters are 
estimated by the method of least squares subject to the restrictions previously 
given. To distinguish them from the estimates derived in eiiuation (3) they are 
designated with double primes (")• If S.* is the total for block i in group X, 
that is from both pairs, and similarly for the other groups, the normal equations 
are: 

Leading term 


m" 





144m" 



= G. 

k'' 

0*1 

6m" 

4 

6b:; 4 («" 

V2 + Va 

+ 

, // , tfu, 

Vi 4" 1^6 4- ) 

= Bu 

7 

but 

6m" 

4 

6bu. 4 

. ft . tf 

+ WlO + 

■ + 

Vao + Vjs "T Vie) 

= But 

n 

Vt 

4m" 

4- 

0*1 

4- b'ui 4 b,i bvj 

+ 

iv” 

= Vi. 

ft 

Vie 

4m" 

4" 

Oxi 

+ byt 4- bii + buj 

4- 

ivn 

» 


Let T,i be the total of all the varieties appearing in block 1 of group X from all 
the replicates; the total of all values appearing in block i of group Y from all 
the replicates, etc. Also 

(8) Cxi = 4jBx. — Txj Cyi = — Tfj etc. 

Solving the equations: 

i// Cxi lif Cjfi 

- Ti “ Tf 

and 

= y+j[(26(7.i 4- Crt + C.,) + 3(C'„, + Cui + C«,)] 

(9) b,i = TiTr[(26(7rf + Ch + C,i) -j- 3 (Cui + Cui 4" (>%»•)] 

bui = 'i4t[(26C'u» -f- Cui 4" Cua) + 3((7,i 4* 4‘ (?»»)]• 

The values of b'^'a calculated as above contain the replicate effects. To cor¬ 
rect for this, adjust the values so that the sum of the block effects for each 
replicate is zero From the corrected b" values and the normal equations with 
the v"'b as leading terms, the corrected varietal sums are calculated. These are: 

(10) ivf' 4 4m" = Vj — Ibti (sum over blocks in which vj appears) 
where 4u” -j- 4m" is the corrected varietal total for the jth. variety. 
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3. Test of signiflcance and the analysis of variance. If the x’a have the 
previously defined values, the following identity occurs; 


= mG + trrE. + tt (5..- - b:. 


8 6 
EE 


) 


(11) + 11 (fl., + b;,) + i; .jv, 


0-1 1-1 




+ S^y - mxi - r,Xi, - 
In the equation (11) 


b,i — b,i &„ + b't( 


^8» “* 


Xu — VjXtj 




( 12 ) 


mO+± r.S, + tt ~ '*•'* (B., - b;,) 


0-1 «-l 


+11 + b;,) + 2 .,L, 


fl.l t-1 ^ 

is the reduction in the sum of squares due to regression and 


(13) 




b„ - b'., „ (6.. + b',,) 


7?MJi " T 0 X2a ™ 2 ■ Xu 


- VjX^ , 


is the residual sum of squares. The reductions attributable to 


11 ~ (B., - b;,) 




and 

(14) 


1 1 2^-^’ (B., + b;,), 




will be designated as component (a) and component (b) respectively. The 
residual mean square will be denoted by s*. 

The common test required is that of the null hypothesis that the variety effects 
‘ , P 3 S are all zero. This test is made by calculating the reduction (Ri) 

to the sum of squares on all variates, and the reduction {R„) due to the regression 
on all variates, except the variety effects. Rt — /?» is called the additional 
reduction to the sum of squares due to the p’s after fitting the remaining variates. 

The ratio (Rt — fZ,)/(82 — 47)8* is distributed as F, as shown by Yates (6), 
with 35 and 205 degrees of freedom. The 35, 205, 82, and 47 degrees of freedom 
pertain respectively to varieties, error, all constants fitted, and the total constants 
less the constants for varieties. 

Referring to formula (11) and the parameter effects, the sum of squares in the 
“Analysis of Variance Table” follow directly for replicate and component (a). 
Nair* in his recent article gives in detail the method for getting out the reduction 
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to the Bum of squares for the eiit-anglcd components. lie showa that the reduc¬ 
tions for component (t)) and the varieties may be written as: 

1 u e ti -t/i 

(16) 

where the b" have l>een correctofl for replicate effects. It is well to note that 

1 u 9 

- 22 23 bfiCti is the reduction due to intra-block eflfecte, freed of varietal effects. 

8 fl—* »—1 

The reduction duo to varieties corrected for block effects is given by 

5SS*"-'+(§?-I’)-(sSt-S)- 

This reduction can be used for testing the variety effects. 


ANALYSIS 

OF VARIANCE TABLE 

Replicate 

D/F 

(8-1) 

N 

Component (a) 

4(6-1) 

1 ^ V (-B.f - B'.if 

8» frl 12 {=[ 

Component (b) 

4(6-1) 

ittCC., 

8 M ^ 

Varieliea 

{ignoring blocks) 

(36-1) 

^ Vi G* 

hi N' 

Error 

206 

obtained by subtraction 

Total 

8(36)- 

1 v-f 


4. Standard error of adjusted varietal means. For obtaining the standard 
error of the difference between two varieties adjusted by the intra-block informa¬ 
tion, this difference between two varieties can be expressed as a linear function 
of the plot yields. The standard error of the difference then can be obtained 
from the standard error of a linear function. To obtain the coefficients, it is 
well to draw a sketch of the plots, and put the coefficient of each plot on the 
diagram. In this way the proper multipliers can bo found in a convenient 
manner. 

First consider the case where the two varieties appear together in the same 
block in both groups Z and U, One such pair consists of varieties (1) and (22), 
for which the varietal effects are designated by Vi and fi. From equation (10) 
we have: 

( 17 ) 


4y" = F, - 4m" - b'Ji - hy\ - b'l - 
4w« = F,i - 4m" - b'Ji - C - b'Ji - b'J,. 



ANALYSIS OP GROUP LATTICE DESIGN 


313 


The linear function of the difference between the varietal effects is: 


(18) 

4(i>« - v") = Fm - Fi + 

- b'Ji + C - C 

where 

b", = ^ (4B.1 - r.i) C 



C = ^ (4B,i - no C 

- i ( 4 Brt - T,,). 

The multipliers [except for the common factor 4 shown on the left of equation 
(18)] are: 


Number of Plots Multipliers 

Contribution to vaiiance 


4 3A + 2 

3*: 

36*“ + 48* + 16 

TF(9fc“) 


4 

3Jfc 

36fc“ - 48* + 16 

Tr(9*^) 


4 4-^ 

64 


^3A: 

F(9fc“) 


4 «, + 2 ) 

36(fc - 2) 

F(9fc“) 


12ft+ 2) ±i 

12(* - 2) 

F(9**) 


Total 

72*“ + 48* 

W{W) 

The variance per plot of the difference between two varietal means for varieties 
which occur together in the same block in groups Z and U is: 

(19) 

72A:= + 48* 3fc + 2 

2TF(16)(9fc) 121Ffc 

and for fc = 6 is -7=. 

18 IP 

Similarly the variance per plot of the difference between varietal means for 
other combinations are as follows: 


Combinations 

formula for k ^ 6 


both in same block in 
groups Z or U 

7 

24TF 


both in same block in 
groups X or Y 

8 

27Tr 


not together in the 
same block 

67 

216TF' 
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6 . Numerical Analysis, (a) The data. In order to illustrate the application 
of the method developed, an experiment used to test the yields of 38 hybrid corn 
varieties is presented. This experiment was carried out on the Arlington Ex¬ 
perimental Farm, and the results are used through the courtesy of A. E. Brandt* 
and M. H. Jenkins.^ 

Except for randomization, the plot yields are as shown in tables I to IV. 
(b). Calculalion for analysis of variance table. PVom page 9, the total sum of 
squares, the sum of squares for lephcates, and the sum of squares for varieties 
ignoring blocks are obtained by substitution. They are: 


and 


where 


(90.9)* + (81.4)* +-h (101.0)’ - c =. 33,546.92 

(3291.8)* + (3300.3)* + • • + (2978.2)* _ ^ ^ 2,m.6i 

(741.2)-+,( C 9Mj^_ - . + ,y<3,l)- _ , _ ,5 825 

s 


(25,935.9)* 

288 


2,335,662.80 


The block sura of squares, eliminating varieties, is mode up of two parts, 
component (a) and component (b). From the formula on page 9 the reduction 
for component (a) is: 

(559.2 - 540.2)* -f (547.0 ~ 522.4)* -f- ■ • • + (615.8 - 507.7)* 

12 

(3291,8 - 3300.2)* + (3256.6 - 3304.7)* 
- d-_i::^^328A6jl2978.2)* ^ ^ ^ 

Component (b) consists of differences giving an estimate of block yield freed of 
varietal effects. The C’s are first calculated by using formula ( 8 ) and the 
results are as follows; 


C,i = (4B*i - r„) = 4(1,099.4) - 4203.2 = 194,4 etc. 

The 6 'b are calculated by using formulas given by (9), and then correcting for 
replicate effects by imposing the conditions that 

e 

S 5^1 = 0 (c ™ a: • ‘ • u) 

1-1 

The corrected h'fi are: 

_bi^_^.79556, hi = -3.83777, • ■ • hu = -0.34306. 

* Acting Chief, Conservation Experiment Station Divisions, Office of Research Soil Con¬ 
servation Service, U.S.D.A. 

‘ Principal Agronomist In charge of Corn investigations, Bureau of Plant Industry, 
U.S.D.A, 



TABLE I 
GROUP X 


Plot Yield Replicate 1 2 


1 

2 

3 

4 

5 

6 


90.9 

81.4 

95.4 

96.9 

96.6 

98.0 

559.2 

7 

8 

9 

10 

11 

12 


96.0 

92.9 

86.3 

96.4 

84.5 


547.0 

13 

14 

15 

16 

17 

18 


79.3 

97.5 

95.9 

80.2 

101.8 

112.1 

566.8 

19 

mm 

■i 


23 

24 


83.4 

■h 

■B 


71.1 

111 8 

538 4 

25 

26 

27 

28 

29 

iHHl 


93.7 

86.1 

68.0 

109.2 

94.9 

93.3 

545.2 

31 

32 

33 

34 

35 

36 


85.3 

81.2 

99.5 

86.9 

93.4 

88.9 

535.2 

S 528.6 

531.7 

536.3 

557.9 

542.3 

595.0 

3291.8 



Plot Yield Replicate 1' 


2 

1 

2 

3 

1 

4 

5 

6 


105.8 

83.5 

68.6 


91.8 

91.5 

540.2 

7 

8 

9 


11 

12 


98.6 

71.9 

81.0 

98.6 

90.3 

82.0 

522.4 

13 

14 

15 

16 

17 

18 


70.5 

90.4 

86.2 

88.8 

99.7 

113.5 

549.1 

19 

20 

21 

22 

23 

24 


94.6 

89.6 

106.8 

99.2 

73.2 

90.9 

554.3 

25 

26 

27 

28 

29 

■i 

■■ 

91.6 

86.9 

74.6 


mm 



31 

32 

33 

34 

35 

36 


91.1 

95.1 

98.8 

95.5 

88.1 

110.2 

578.8 

S 552.2 


n 

585.2 

545.4 

584.1 

3300.3 


31S 














































TABLE II 
GROUP Y 
Plot Yield Replicate $ 


S 


1 

85.9 

7 

96.6 

13 

85.4 

19 

86.4 

25 

88.8 

31 

89.7 

532.8 

2 

87.1 

8 

83.5 

14 

86.9 

20 

88.1 

26 

89.1 

32 

102.7 

537.4 

3 

88.4 

9 

85.5 

15 

90.4 

1 

21 ! 27 

99.7 ! 80.5 

1 

33 

100.2 

1 

544.7 

4 

88.5 

10 

72.3 

16 

89.5 

22 1 28 ! 
95.6 j 105.5 

34 

82.6 

634.0 

5 

87.0 

11 

88.1 

17 

101.8 

23 

82.5 

1 

1 29 

86.8 

35 

100.1 

546.3 

6 

90.8 

12 

83.4 

18 

101.2 

24 

120.2 

30 

72.6 

36 

93.1 

561.3 







3256.5 


Plot Yield Replicate B' 2 


1 

95.1 


13 

86.4 

19 

74.3 

25 

93.0 

31 

86.7 

530.5 

2 

96.5 

8 

84.2 

14 

79.0 

20 

88.1 

26 

95.6 

32 

101.3 

644.7 

3 

95.4 

9 

83.3 

16 

95.9 

21 

99.0 

27 

66.0 

33 

105.3 

544.9 

4 

81.4 

10 

95.0 

16 

91.6 

22 

101.4 

28 

108.5 

34 

90.5 

568.4 

5 

91.8 

11 

107.6 

17 

84.2 

23 

66.1 

29 

87.6 

35 

101.6 

538.9 

6 

92.2 

12 

89.6 

18 

104.1 

24 

116,0 

30 

81.6 

36 

93.9 

577,3 







3304.7 
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TABLE III 
GROUP Z 
Plot Yield Replicate S 


2 


1 

87.3 

8 

79.9 

15 

86.9 

22 

105.0 

29 

99.4 

36 

90.3 

548.8 

2 

90.0 

9 

93.0 

16 

93.1 



31 

94.1 

534.4 

3 

91.2 

10 

92.9 

1 

17 

90.6 

24 

92.3 

25 

76.0 

32 

97.2 

540.2 

4 

87.8 


18 

125.1 


26 

88 3 

33 

98.1 

599.6 

5 

84.3 

12 

93.7 

13 

73.9 

20 

84.4 


34 

89.8 

492.8 

6 

90.1 

7 

91.3 

14 

85.4 

21 

95.4 

28 

93.7 

35 

101.6 

557.5 







3273.3 


Plot Yield Replicate 3' 2 


1 

99.4 

8 

83.5 

15 

70.9 

22 

99.9 

29 

103.0 

36 

69.0 

525.7 

2 

92.2 

9 

96.0 

16 

98,1 

23 

74.7 

30 

89.8 

31 

103.6 

554.4 

3 

91.9 

10 

106.4 

17 

92 7 

24 

108.3 

25 

88.8 

32 

103.4 

591.5 

4 

99.0 

11 

105.4 

18 

101.2 

19 

78.1 

26 

90.5 

33 

98.1 

572.3 

5 

63.7 

12 

94.4 

13 

80.7 

20 

78.4 

27 

71.3 

34 

86.9 

475.4 

6 

81.5 

7 

88.6 

14 

90.4 

21 

84.1 

28 

93.7 

35 

88.9 

527.2 







3246.5 
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TABI,E IV 


CJROUP U 

Phi Yield Replicate 4 2 


31 

1 

26 

21 ‘ 

16 i 

11 j 

6 


98.5 

99.3 

97.6 . 

! 

90.9 ; 

102.5 

^ I 

91.5 

580.3 

1 

32 1 

27 1 

22 i 

17 

12 


95.9 

92.3 ! 

1 

70.0 ; 

99.2 1 

1 

85.6 ! 

■ 

100.6 

543.6 

7 

2 i 

33 i 

28 ] 

23 

18 


77.8 

79.9 1 

98.1 1 

104 8 ' 

88.9 

115.7 

565.2 

13 

8 

1 

3 

34 1 

29 

24 


78.G 

81.3 

84.1 

86.9 i 

91.3 

111.8 

534.0 

19 

14 


! 

35 

30 


82.6 

89.0 

75.0 : 

94.1 i 

j 

108.3 

96.7 

545.7 

25 

20 

15 

10 1 

5 

36 


87.3 

76.2 

89.7 

83.7 

82.2 

96.7 

515.8 







3284.6 



Plot Yield Replicate // 


2 

31 

26 

21 

16 

11 

6 


83.1 

88.3 

84.8 

94.5 

73.6 

84.4 

508.7 

1 

32 

27 

22 

17 

12 


80.9 

82.6 

73.9 

94.8 

75.8 

83.4 

491.4 

7 



28 

23 

18 


93.3 



87.8 

83.2 

94.7 

544.2 

13 

8 

3 

34 

29 

24 


74.6 

68.2 

45.2 

79,0 

87.6 

102.1 

456.7 

19 

14 

9 

4 

35 

30 


69 1 

81.2 

80.3 

68.8 

83.7 

86.4 

469.5 

25 

20 

16 

10 

5 

36 


89.6 

71.7 

75.1 

97.1 

73.3 

101.0 

507.7 







2978.2 
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To get the reduction due to component (b) the above results are substituted in 

1 u 6 

o Z E C C.i = 1,389.96. 

O e—a 1—1 

The necessai-y results are now available for the “Analysis of Variance Table.’' 


THE ANALYSIS OF VARIANCE TABLE 


Source of Variation 

Degrees of Freedom 

Sum of Squares 

Mean Square 

Replications 

7 

2,289.68 

327 097 

Component (a) 

20 

1,415.27 


Component (b) 

20 

1,389.96 


Blocks (eliminating 

40 

2,805 23 

70.131 

narieties) 




Varieties (ignoring 

35 

15,825.09 


blocks) 




Error 

205 

12,626.92 

61.595 

Total 

287 

33,546 92 



(c) Test of significance There frequently will be large differences between 
varieties so that a test of significance may not be needed. If a test is needed, 
one involving only intra-block information may be used For this purpose, it is 
necessary to calculate the sum of squares for varieties eliminating block effects 
as shown by formula (15): 13,946.28 The mean square will be 399.893, and 

F = = 6.49 which is highly significant. 

61 <595 

(d) . Corrected varietal totals and means. The right-hand side of equation (10) 
gives the corrected variety totals, and when divided by eight gives the varietal 
means These corrected varietal means can then be compared to determine the 
best variety. The corrected varietal totals and means are: 


Corrected Varietal Totals 


1 

2 

3 

4 

5 

6 

743.22 

669.05 

652.00 

705.80 

672.04 

720.32 

7 

8 

9 

10 


12 

747.59 

658.58 

664.57 

751.39 


735.95 

13 

14 

15 

16 

17 

18 

642.31 


686.41 

713.21 

730.79 

857.26 

19 


21 

22 

23 

24 

665.95 


756.25 

801.34 

619.46 

868.84 

25 

26 

27 

28 



704.17 

699.83 

567.71 

814.04 



31 

32 

33 

34 

35 

36 

721.79 

757.48 

783.42 

726.05 

780.48 

760.37 
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Correcled Varietal Means 


1 

2 

3 

4 

5 

6 

92.902 

83.631 

81.500 

88,226 

84.005 

90.040 

7 

8 

9 

10 

11 

12 

93.449 

82.322 

83.071 

93.924 

92.442 

91.994 

13 

14 

15 

16 

17 

18 

80.289 

87.565 

86.801 

89.151 

91.349 

107.158 

19 

20 

21 

22 1 

23 

24 

83.244 

84.425 

94.531 1 

100.168 1 

1 

77.432 

108.605 

25 

26 

27 

28 

29 

30 

88.021 

87.479 

70.964 

101.755 

95.439 

84.930 

31 

32 

33 

34 

36 

36 

90.224 

94.085 

97.927 

90.756 

97.560 

93.046 


When comparing one variety with another it is necessary to know the standard 
error of the mean difTerence, in order to judge whether this difference is signifi¬ 
cant. The formulas for the standard error of the difference between mean yields 
differ for those sots of varieties which occur together in the same block in groups 
Z and U, in groups Z or U, in groups X or Y, or do not occur together in the 
same block. The formulas for these calculations are, respectively: 

(19), (20), (21), and (22). For example, the standard error of the 
difference between two variety mean.s, such as variety 1 and 2, is 

A (61.595) = 4.27, 
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NOTES 


This section is devoted to brief research and expository articles on methodology 
and other short items. 


ON THE EXPECTED VALDES OF TWO STATISTICS 

By H. E. Robbins 
Post Graduate School; Annapolis, Md. 

In a previous paper\ the following theorem was proved Let Z be a random, 
Lebesgue measurable subset of Euclidean m dimensional space Em , and let 
p.{X) be the measure of X. For every point x of Em let p(x) be the probability 
that X contains x. Then 

(1) EUX)) = f p(x) d^(x). 

In the present note we shall show how this theorem may be used to find the 
expected values of two statistics which arise in sampling theory. Applications 
to similar problems may suggest themselves to the reader. 

Let F be a real random variable with c. d. f. (cumulative distribution function) 
a{y), so that for every y, 

(2) Pr {Y < y) = a(y). 

Let Fi, • • • , F„ be n independent random variables, each with the distribution 
of F. Finally, let 

A = min (Fi, • • • , F„), 

B = max (Fi, • • • , F„), 

(3) R = B - A, 

F = c{B) - v(A). 

Although the values of E{F) and E{R) can be found from the sampling distribu¬ 
tions of F and B, and, in fact, are well known, we shall show how to apply (1) 
to find E(F) and E{R) directly. 

To find the first of these, let X denote the set of points in the interval 0 < a; < 1 
such that 

(4) v(A) < X < <t{B), 

Then Z is a random set with measure 

(5) m(Z) - F. 

Moreover, for any point x the probability that Z shall contain x is clearly 

(6) p(a;) = 1 - - (1 - x)*. 
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Hence by (1), 

(7) FMX)) = j[ [1 - x" ~ (1 - x)"] dx 


Thus by (5), 

( 8 ) 


E{F) 


n — 1 
n'+“l' 


n — 1 
71+2 


This result, may also be derived by the usual method. In fact, it is not hard 
to show that the o. d. f. of F is 


(9) r(J) = Pr (F </) = (!- a)/" + n/"-' for 0 < / < 1, 


whence 

EiF) = [fdrif) 

( 10 ) 


(1 — n)n f d/ + n(7v — 1) df 

_ (1 — ?i)n n(n — 1) _ n — 1 
a + 1 n n + 1' 


Here the advantage of using (1) is only that it makes unneciessary the calculation 
of the c. d. f. r(J), provided that only E{F) is desired. 

The situation is quite otherwise with E{R). Here the c. d. f. of R is 


(11) d{r) = Pr {R < r) = n(n ~ 1) f ^(a) f" ^(b) f [' ,p(l) d«T"’di)dfl, 


where (fi is the probability density function of Y. Unless vu is a very simple 
function, it would seem difficult to find a simple expression for the integral 


( 12 ) 



rdffir). 


However, if we let X now denote the linear set 
(13) A <t < B, 

then 


(14) fi(X) = B - A = R. 

The probability that X shall contain the point t is now 
(16) fit) = 1 - ^”{t) - (1 - 

80 that, by (1) and (14), 

(16) EiR) * r {1~ <r"(0 - (1 - <r(0)"l dL 

•^00 

This formula for the expected value of the range in a sample of n from a popula¬ 
tion Y with c. d. f. <r{t) is believed to be new. 
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If ir(i) is such that dtjda can be found as an explicit function of a, then (16) 
can be written with advantage as 

(17) £(«) = r (1 - - (1 - <!)") ^ da. 

■'0 do 


For example, suppose the random variable Y has the probability density function 


(18) 

and hence the c. d. f. 


fiy) = 


(1 + e")^ ’ 


(19) 

Then 

( 20 ) 


<^{y) 


1 + c" ■ 


t = log 



— - 1 
do a(l — a) 


Hence from (17), the expected value of the range in a sample of n is 

(21) E{R) = f r do. 

Jo ff(l — o) 


The indicated division m the integrand may be carried out, and the result, a 
polynomial in a of degree < (n — 2), when integrated between 0 and 1, gives 
an explicit formula for F(i?). Thus for samples of n = 2, 3, 4 we find the values 
of E(R) to be respectively 2, 3, 11/3. Incidentally, it is always true that the 
expected value of the range for n = 3 is three-halves that for n = 2 This 
follows from (16) and the algebraic identity 

( 22 ) {1 - cr ^ - (1 - ^)=1 = 111 - a ^ - (1 _ a )^}. 


REFERENCES 

[1] H. E Robbins, “On the measure of a random set,” Annals of Math Slat , Vol 15 
(1944), pp. 70-74. 


ON RELATIVE ERRORS IN SYSTEMS OF LINEAR EQUATIONS 

By A. T. Lonseth 
Northwestern University 

Some time ago in these Annals^, L. B. Tuckerman discussed the effect of rela¬ 
tive coefficient errors on relative solution errors for a non-singular linear algebraic 
system; his discussion was confined to errors so small that their squares and higher 
powers can be neglected. Dr Tuckerman’s paper was principally concerned 


* L. B. Tuckerman, “On the mathematically signihcant figures in the solution of simul¬ 
taneous linear equations," Annals of Math. Slat , Vol. 12 (1941), pp. 307-316. 
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with the important problem of limiting erroi-b incurred while solving the syatem, 
and has suggested the desirability of a non-infinit-esimal treatment of relative 
errors. Such a treatment follows; the metho<l is a variant of that used in a 
paper on absolute errors'^ The computations provide (1) a oriterion for allow¬ 
able relative errors m the coefficients to assure non-vanishing of the deter¬ 
minant; (2) a bound (subject to this criterion) tor the relative error in OAch solu¬ 
tion; (3) a speeilicatinn of accuracy in the coefficients to assure a pro-assigned 
accuracy in the solution. 

We con.sider a system of linear (‘quations 

n 

(1) S aiix, = C( t » 1, 2, • • > , n, 

where none of the following vanish; the a(n + 1) coefficienta a.-j, c,-; the deter¬ 
minant A of the By.stem; and the n solution-components x,. Under these condi¬ 
tions it is possible to speak of “relative errors’’ in the o’a, c’s, and x’s. Let 
<,j , o-i be the relative errors in a,y and c,- respectively, so that a,j is perturbed to 
a,/I -b e,j); c, to ci(l +• cO- We inquire as to limitations on us and which 
will permit solution for x/(l + p/) of the system 

(2) Yh + Pi) + <ri) 1 « 1, 2, ■ • ■ , n, 

/-I 

where p, is the relative error induced in Xj; and we seek to limit ] py) in terms 
of the <’s and a's. We shall assume that for all i, j 

(3) I I, kv 1 < «. 

where 5 will be suitably restricted later. 

Combining (1) and (2) we get 

It n ft 

(4) a*yXjpj = CiCi ' Pi f * " ' ) 

j-1 i-1 »-l 

Since by hypothesis the determinant A of (1) is not zero, matrix A = (aj,) has 
the inverse = (A /,/A), where A,^ is the cofactor of oj/ in A. Mul¬ 

tiplying (4) by bki and summing on i we get 

w n n 

( 6 ) Xkpit ~ YL budfff ~ Y^ hi Y2 ai/(,jXi 

1-1 <-i /-I 

H n 

— Y)^uY) O'iiUjXipj k — 1, 2, ‘ n, 

M y-i 

and by (3) 

(6) P ^ S(M* + Nk\pk 1). 

’ A. T, Lonaeth, “SystemB of linear equations with coefficients subject to error,” Annals 
o/ Math. Slat., Vol. 13 (1942), pp. 332-337. 
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where p is the greatest [ p* |, and 

I 1 <-l \ J-1 / 

( 8 ) N, ^ ±t\b,,a,iXi\, 

I X/t I f_l j-1 

so that 

Mil = Nk -{• I—I S I 1 • 

|xt| i-l 

Denote by M, N the maximum values of Mk, Nh respectively over fc = 1, 2, ■ • • , 
n. From (6), 

p g 5(M + Np), 

whence, if 

(9) 3 < 1/iV, 
it follows that 

(10) P ^ 3M/(1 - SN), 

which of course bounds each individual ] pk |, though rather crudely. To 
bound I ph I more genuinely in terms of S, Mk, Nk, M and N it remains only to 
use this inequality with (6): 

(11) I PI I S 5(Mk + 6AfiVi/(l - 5N)), fc = 1, 2, • • • , n; 

with Mk, Nk ss given in (7) and (8). 

If (9) holds, then, it follows that [ p* 1 is bounded by (11)—if pi exists. This 
essential point can be established by solving (5) for pi by iteration”; (9) is a 
suflS.cient condition for convergence of the resulting series, and hence for non¬ 
singularity of the perturbed matrix (a<, -j- e,^,,). 

In order to be sure that ( pi | ^ ri, a, pre-assigned number, for all k, it suflSces 
by (10) to choose 3 so that 

SM/(1 - SN) ^ V, 

whence 

5 g 7,/{M + Nv). 

A less simple inequality whose satisfaction by 6 will guarantee that | pi | £ ijt 
follows from (11), namely 

a ^ (A - B)/2C, 

Where A = {(M* - Ni/kf -f iMNkrt>>}\ 5 = Afi + iVij* , C = | MNk - NMt |. 
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A RECIPROCITY PRINCIPLE FOR THE NEYMAN-PEARSON THEORY 
OF TESTING STATISTICAL HYPOTHESES 

By Louis M. C'oriir 

In contniHtinK the tesUHl hypothesis H\ with the alternative /fj, i.e,., in 
comparing the probability distribution p(xi, • • ■ , x„ | 7/0 associated with the 
fn-st hypothesis with the. distribution p(xi , • ■ ■ , Jn | Ih) associated with the 
second, Neyman and Pearson select the hmt critical region R* from the infinite 
set of critical regions R of a specified size, a by minimizing the probability 

(1) / pixi, , Xn \ Hi) dxi ■' ■ dx„ 

of accepting H\ when Hi is true (Type 11 Errors) subject to the constancy of the 
probability of rejecting Hi when. Hi is correct (Type I PlrrOrs), 

(2) I vixi ,■■■ ,Xn\Hi)dxi - dx„ == a. 

S in (1) represents the whole of variate (ii, • ■ , x„) space and H - R, the com¬ 
plement of R relative to S. 

Obviously (1) is conditionally minimized when 

(3) / p(xi, • • • , x„ 1 7/i) dxi ■ • • dXn 
•Ik 

is maximized subject to (2), Neyman and Peamon have show'n that if one or 
more members of the one parameter (X) family of regions R*(\) defined by the 
inequalities 

(4) p(ii, •' • , Xn I 770 ^ Xp(xi, ■ • • , x„ I /7i) 

satisfy the "side” condition (2), they will he best critical regions maximizing (3) 
subject to (2) or minimizing (1) subject to (2)'. As suggested by the notation, 
the family 72*(X) depends upon X and, if sufficient restnotions are imposed upon 
pfxi, • • • , x„ I Hi) and p(xj, • - • , x„ | Hi), there is one and only one region for 
every value of X lying in an interval contained in the positive half-axis. X, 
itself, is clearly a function. X(<i) of a. Consequently, 72* (X) depends upon a 
and may be written as 72*[«]. The best critical region for a preassigned size 
a is given by 72*[a]. 

Will we get the same best critical region if among the regions T that fix the 
probability of Type 11 Errors, 

(5) / p(xi , ,x„\Hi)dxi ■■ ■ dxn - 1 - d, 

' For a full exposition, see Neyman and Pearson, Slat. Res. Memoirs, Vol 1 (1936) 
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we find the one that minimizes the integral in (2) with R replaced by T, i.e 
if we find the one that minimizes the probability of Type I Errors? We shall 
call this turnabout of the usual process the reversed Neyman-Pearson principle. 

To discover the answer, we note that / p{xi , • • , x^] Hi) dxi ‘ • dxn is equal 

to unity and (5) may be rewritten as 

(6) / p{xi , ■ ‘ , a:„ I ifx) ci!a:i • • • = /3. 

J J* 


The regions that minimize the left side of (2) with R replaced by T subject to 

(6) are obviously identical with those that maxiinize the negative of this left 
side subject to (6) multiplied through by —1. The latter problem is formally 
identical with the one referred to in the second paragraph of this note and, in¬ 
voking Neyman and Pearson’s result, we conclude that the said conditional 
maximization is effected by the one parameter (p) family of regions T*(fi~^) 
defined by the inequalities 

(7) -p(X: , • • ,X,^ I Hi) ^ -Mp(Xi ,Xn I Hi) 


or 


-1 , 


p(xi , • • jXniHi)^- p(xi, • • •, a;„ I Hi). 

p 


ju in T*{p~ ) denotes the reciprocal of p. It is clear from (4) and (7) that the 
families of regions R*{\) and T*{p~''), satisfying the direct and reversed Neyman- 
Pearson processes, coincide 

As before, p is some function p{0) of j3. Hence, /3 is a function ^{p)^ of p and, 


accordingly, a function i3 


1 ~ 


of a. 


Consequently, if the level at which the 

probability of Type II Errors in the reversed Neyman-Pearson process is held 

constant is taken equal to 1 — )3 m terms of the level a at which the 

probability of Type I Errors is fixed in the d%rect Neyman-Pearson method, the 
reversed and direct processes yield the same best critical region. This is the 
reciproaty principle alluded to in the title of this note m its full completeness. 


* p{p~^) will generally be distinct in form from a(X), although the second line in (7) coin¬ 
cides upon the substitution of X for with (4), since the integrand in (5) is p{xi , ■ ■ ■ , 
Zn 1 Hi) whereas that in (2), regarded as a constraint in the direct process, is p(zi, ■ • ■ , 
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AN INEQUALITY DUE TO H. HORNICH 


By Z. W, Birnbaum and IIerbkht B. Zuckkrman 
University of Washington 


H. Hornich‘ i)rove(i a theorem on the averaRP. riek of the mim of e«[ual insurance 
policies. It seems of interest to note that when translatwi from its actuarial 
formulation into the te.rminology of the calculus of probabilities this theorem 
becomes an inequality for mean deviations of random variables, and to present 
it with a concise proof in non-actuarial language. 

Let a: be a random variable with a symmetrical probability distribution, Di = 
£( I X I) its mean deviation, x,, xi, • • • , x» independent repetitiona of x, and 
= E(| xi + Xa + • • ‘ I) the mean deviation of xi + xj + ■ • • + Xn . 
Then D„ fulfills the inequality 


( 1 ) 


X) > 

& 2"“1 



where 



denotes the greatest integer ^ -, 

li 


If the distribution of x is not 


symmetrical but E(x) = 0, the inequality becomes 


(2) 


Dn 




D\n 

2 " 



The proof will bo given for a continuous random variable but it clearly holds 
quite generally. If/(x) is the probability density of x, and E{x) = 0, then one 
has 


(3) 




f |x|/(x)dx 



dx. 


In the expression for D„ , the integration over the entire n-space (xi, xj, • ■ ■, x„) 
may be performed by integrating separately over each of the 2" "octants” which 
correspond to the different combinations of signs of the coordinates, and thus one 
obtains, for a symmetrical distribution, the estimates 


i -f#o rt n n 

f f X( n/(^<) n dxi 

tc »^«e I*-! 



E 

«l—Jclf 


/ I - I 


!!-l 


■KnxiMacQAt^' •. 




2 E 


(:) fi-J 


aicn#i-iin*j- 


acnsa*>'>l 

—agn*»-+l 


' Hans Hornich, “Zur theorie des Risikos,” Monalth. Math. Phys., Vol. SO (1941), pp. 
142-150. 
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Bgn3!i^Biignx2* •BdgQXfM—1 
agn a, + 1 -" B gn «j + j— • » «sd *«—+1 

-="£"{;)>-■ A{-“'r{;)->"r-(;)) 
-srs"(;)-"'"r'c:')) 


-j 3 i 4 ;])*“T''(::i)-"T'C;')l 




If X is not symmetrical but E{x) = 0, we consider the random variable x' 
with the probability density g{x') — and the random variable y — 

X + x'. In view of (3) we find 

■B( I y 1 ) = jf j_ I X + x' l/(x)5(x0 dxdx' S 2 jf jf (x + x')f{x)g(x') dx dx' 


= 2 j j ^/(^) dx dx' + 2 y fix) j x'gix') dx' dx 

= E(x) jf gi—x) dx + fix) dx| = Eix). 

Let ii, xi, • ■ , x„ and x{ , x'^, ■ , x'„ be independent repetitions of x and x', 

respectively, and y, = x, + x^. Since y has a symmetrical distribution, an 
application of (1) gives 

£^(| xi + Xj + ■ ■ ■ x„ I) = h{Eli\ xi + • • • + x„ 1) + £?(1 xi + • • • + x^„ |)} 

^ xi + Xi + — + x„ + x„ I) = yi d- • • • + yn I) 

> 1 g(|y|)n /”r~ 1 ^\ > g(l X |)n 
-2 2.-> 2- 

An application of Stirling’s formula shows that the right hand sides in (1) and 
(2) are of the order of magnitude of Vn- 
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NOTE ON A LEMMA 


By Abraham W vir) 
Ciilumtria Ihiivcrtuly 


In a prcviouh pai)i*i- (in tin* power funetioa of the uiialyein of variance tt'st‘, 
the avithor atated tin* follnwinn lenainn (dcHiffnated (here st-s lA'inma 2): 

T.kmma 2. Let I'l , • • ■ , hr k normally and indrprndnilly distributed variates 
with a common variance <r’. Denote the mean value of v, by t*. (/ -- k) 

and let f{ui, ■ ■ ■ , Vk, a) be a function the variahleti Vi , ■ • • , Vk and a which 

does not involve the mean valws ai, — , at . Then, if the ecpecled value of 

/(wi, ■ • • 1 y*. 1 ^) iR equal to zero, f{vi , • • , t\ , a) is idenitenlly equal to zero, 

except perhaps o»i a set of measure, zero. 

In the pape,r mentioned above it was intendofl to state this leruina for hounded 
functions f{ui, • • ■ , u*) and the lemma wjis used there only in a case where 
f{vi , • ' I u*) is bounded. Through an oversight tins reslrietion on /(ci , ■ < ■ , vf) 
was not stated explicitlyThe, published proof of [ycmma 2 is adequate if 
/(vi >■•■)«*) is assumed to he hounded. From the fact that the moments of a 
multivariate normal distribution determine unicpiely the di.sfrihution it is 
concluded there that if for any set (ri, • • • , rt,) of non-negative integers 

«o 

(1) ■ ■ • «!'••• vl^fivi , • • • , ua)c dei ■ -. dm - 0 

•i~ao ^90 

identically in the parameters «!,•••,«* then /(n , • • ■ , e*) must he etpial to 
zero except perhaps on a set of ineusure zero. 'Phis conclusion i.s obvious if 
/(«! ,••■,«*)«) hounded. In fact, from (1) and the l)oundcdnc.ss of/O'i, • • ■ , ca) 
it follows that there exists a finite value A .siu'h that 

is a probability density function with moments equal to those of the normal 
distribution 


f'iUi , ,Vk) 


ISl",—1>,)2 

f2T)*« 


Hence f{vi , v*) must be equal to zero except perhaps on a set of measure 
zero. However, this conclusion is not so immediate if no restriction is imposed 
on /(ci, • ■ ■ , y*) except that 

L -••••"*) I dt;i ■ • • dvk < ~ 


for all values of the parameters ai, • - ah ■ It is the purpose of this note, to 
prove this. In other words, we shall prove the following proposition: 


' A. Wald, "Oa the power function of the analysis of variance teat,” AnnaU of Math 
Stal., Vol. 13 (1942), pp. 434. 

® I wish to thank Prof. J. Neyman for calling my attention to this omission. 
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PHr'POsmoN I. If (2) holds for all values of the parameters ai, ■ ■ ■ , uk and 
if for any set (ti , ■ , ?■*,) of non-negative integers equation (1) holds identically 

in aj., ■ • , ak , then f{vi, ■ • , Vk) must be equal to zero except perhaps on a set 
of measure zero. 

On the basis of Proposition I and the arguments given on p. 438 of the paper 
mentioned before, it can be seen that restriction (2) on the function/(wi, • • , Vk) 
is sufficient for the validity of Lemma 2. 

To prove Proposition I, we shall first show that the following lemma holds. 

Lemma A. If h(vi, ■ , Vk) is a probability density function and if 


(3) 


--1-00 s 2 

/ ■ ■• / h(vi, ■■•,Vk)e ' 

•^00 


« s I'll 


dvi 


dvk < “ 


for some S > 0, then the problem of moments is determined for the moments of the 
distribution h(vi, ■ ■ ■ ,Vk). 

This lemma was proved by G. H Hardy for fc = 1.’ I shall prove it for 
A: > 1. Since 


E 

n—0 




(2n)! 


< e' 


i£|rj 


(4) 

we obtain from (3) 

(5) 

Hence 

( 6 ) 

Denote the 2nth moment of y, by ft 2 n . Because of (3) the moments are 

k 

finite Furthermore, denote ^ by Xi„. i’hen we obtain from (6) 


--fao 

■ h(vi , 

Vk) 

^ 11 )^’’’ 

dvi • 

■■ dvk < w 


.^0 (2n)I . 


-+0G 





L - 

■ jL«, 

• • •, tit) 

V' \»-i / 

{2n)\ J 

dvi • • 

• dvk < '>5. 


(7) 

From (7) it follows that 

( 8 ) 

Hence 

(9) 


i:^"< =0. 

^ (2n)! 


““.““(Si)'" ^ 


> See for instance, Shohat and Tamarkin, “The problem of moments,” Math, Surveys 
No. 1, Amer. Math. Soc., New York, 1943, p. 20. 
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Since according to Stirling's formula 

Urn (2n)!/(2a)*"(>-*"V4';;Ti ^ I 

we obtain from (9) 

1\ 1/*** 

(10) 2^-* - 

Taking reciprocals we obtain 

(11) liminf.^”T >1 
or 

(12) lim inf > ^ > 0. 

rv<»4« 

But (12) implies the existence of a positive value p so that 

(13) ~ (n « 1, 2, • • •, ad inf.) 

7»' 

From (13) it follows that 

(14) 22 xr,!'** » «. 

A«-l 

But (14) is Carleman's sufficient condition for the deterrninateneas of the prol> 
lem of momenta, Hence Ixjmma A is proved. 

On the basis of Lemma A we can prove Proposition I as follows: From (2) 
we obtain 

(16) f ■ ■ l^\ M , • • • , a*) I dv, ■ ■ • dv, < 

for all valiie.s ai, • ■ • , a*. . I^t /i(u) = /(e) for all points v = (un , • ■ ■ , r*.) 
for which /(y) > 0, and Ji{v) = 0 for all points v for which f{v) < 0. Similarlj-, 
let/ 2 (y) = -/(u) for all points v for which/(e) < 0, and /t(u) = 0 for all points 
V for which f{v) > 0. Then /i(y) and /i(y) are non-negative functions and 

( 16 ) m = Mv) - Mv). 

From (16) it follows that 

(17) r” f''”/.(y)«“‘^»?+*'“'‘ dvy- dv, < oc 

4—«o 

and 

£ +« f 

■•• / /*(y)e-*=»J+=-''dy^ - dy* < oo. 

go «^flO 
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Let 

(19) fUv) = /.(t')e"*"’' (j = 1. 2). 

Now we shall show that for any positive values /3i, - ■ - , /3i 

(20) r°° • ■ , ■ ■ •, dv, dv, < 

l4^gO •fmog 

In fact, consider the 2*" sets (ai, • • ■ , ai) where a, = d=l (f = 1, ■ • • , k). 
Denote by Rai -a^ the subset of the fc-dimensional Cartesian space which con¬ 
sists of all points v = (wi, - • • , %) for which Vi is either zero or signum v, = 
signuin a, (i = 1, ■ • ■ , fc). Putting = a,/3,, it follows from (17) and (18) 
that 

(21) f f,{v ,, ■ ■ • , ••+'’‘'"*1 dv, - dv, < 

Since (21) holds for any of the 2*" sets Ra^.. at, equation (20) is proved. 

From (1) it follows that 

f ■■ f • aj* [ft (vi, yVii) - ft(vt, ■■■ , vjfc)] dai • • da* = 0, 

oo •Loo 

for all non-negative integers n , • • • , . Hence, because of (21) and Lemma A 

we see that 

(22) ft(vi, , Vk) = fi(vi, > Vie), 

except perhaps on a set of measure zero. From (22) it follows that 
f{vi, jVm) = fiivi , • • • , a*) - Mvi , • • ■ , a*) = 0, 

except perhaps on a set of measure zero. Hence Proposition I is proved 

A NOTE ON SKEWNESS AND KDKTOSIS 

By J Eknest Wilkins, Je. 

University of Chicago 

It is the purpose of §1 of this paper to prove the following inequality: 

(1) 04 ^ al + 1. 

This inequality seems to have first been stated by Pearson^. The inequality 
also follows from a result appearing in the thesis of Vatnsdal. Here we give a 
proof based on the theory of quadratic forms which seems to be more direct 
and more elementary than either of the previous proofs. 


^“Mathematical contributiona to the theory of evolution, XIX;second supplement to 
a memoir on skew variation,” Phil. Trans Roy. Soc {A), Vol. 216 (1916), p. 432. 
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The inequality ( 1 ) ohviouKly Hhowa that 04 S 1 . It i.s then natuial to ask for 
an upper bound for on . In §2 we .shall .show tliat there i-s no univensal upper 
bound (independent of the number N of quantitic.s in the distrilnition) for aa. 
In fact we find the actual dependence of the maximuin poasihle vahu* of 03 as 
a function of A". The form of thi.H function .seems to he known hut not to have 
been rigorouHly proved before. It then follows from (1) that there i.s no uni¬ 
versal upper bound for . 


1. The inequality (1). Tet u.s coasider the (|uadratie form 
fi{a, h, c) ~ pqo^ -j- 2piab -j- 2piac -h Pulf -|- 2pJk 
= Ar"'s(a -f- Jrh + 

It follow.s that Cr(o, b, c) is a positive .semi-delinite quadratic form. In fact, 
if there are at least three distinct values of x, then G(a, b, c) is a positive definite 
form. Consequently, its discriminant 


va 


Vl 

Vi 

Vl 

V) 

Vl 

V) 

Vi 


must be non-negative. There is no loss of generality in supposing that vi = 0, 
VI = 1 , in which case we find that 


1 0 1 

0 1 CTJI 

1 «! 04 


S 0. 


Expanding the determinant, we get the inequality (1). 

We remark that equality holds in (1) if and only if there are only two distinct 
values of x. 


2 . The maiiraum value of oi. It is clear that this ma.\imum will be N~^ 
times the maximum value of the function f{x) = 2 x' on the bounded closed set 
consisting of those points x for which g{x) = Sx* = A'" and h(x] = 2x = 0. 
According to the Lagrange multiplier rule, this latter maximum is obtained as 
follows. Let F(x) = f{x) — \g{x) — tih{x). Then the maximizing point 
satisfies the relations 

Fx^ = 32:5 - 2Xa:,' - p = 0, 2 a:’ = N, 2a; = 0. 

The equations 2 F* = 0, 2xF^ * 0 shows that ^ « 3, « 2A'‘X/3. Solving 

the equation F,, = 0 gives 

(2) = [X -f- edX’ + 9)‘]/3, 

where e, = ± 1 . For these values of a:, we shall have hix) = 0, g(x) = iV if * 
and only if 


^ = -(X* + 9)*A“’2e. 
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Therefore X has the sign opposite to that of Se, and 

~ (Sc)'] = 9(Sc)l 
It follows that he ±iV, and that 

(3) X = -3Se/[iV' - (Se)']‘, 

/n.a. = -2iVSe/[JV' - (Sc)']^ 

We have still not obtained the maximum, however, since the mimmum will 
also satisfy all of the relations deduced above. We distinguish the maximum 
from the other critical values by examimng the function 

e(s) = -2]\fS/(W' - sV. 

Since Sc ^ ±Nj e, = ±1, it is clear that JV-2^Sc^2 — iV. We therefore 
consider d{h) on the interval (2 - W, iV - 2). We find that 

de/dh = - 2 ivV(j\r' - fp < 0 , 

so that ^ IS a decreasing function of 2 on the interval indicated. Its maximum 
value will therefore occur when 2 = 2 - iV, and this maximum value will be 

d{2 - W) = N{N - 2)/{N - 1)\ 

The value 2e = 2 - jY occurs only when one of the e,, say Ci, is equal to +1 
and all the rest are equal to -1. Then we find from (3) and (2) that 

X = 3(Y - 2)/2{N - 1)\ 

(4) Xi= {N - 1)*, Ij = X3 = • ■ - Xff = -{N - 1)"\ 
aa = I{x)/N ={N- 2)/{N - l)^ 

Since the maximum value of aa given by (4) approaches °o with N, it follows 
that there is no universal upper bound for 03 . More precisely, the quantity 
as can be made as laige as desired by choosing N large enough and then picking 
x^ as m the last paragraph. Since there is no universal upper bound for 03 , 
it IS clear from (1) that there is no universal upper bound for ou . It would 
probably be possible, although rather difficult, to derive an explicit bound for 
ffli as a function of N by using the methods employed above for as ■ 



NEWS AND NOTICES 

Readers are invited to submit to the liecretary of the Institute news items of general interest 

Personal Items 

Mr. Carl A. Bennett is doing war research on a project at the University of 
Chicago. 

Dr. George W. Brown, formerly Itesearoh Associate at Princeton University, 
is now at the RCA Laboratories in Princeton, New Jersey. 

Professor Harry Carver is on leave of absence from the University of Michigan 
to do Operations Analysis work with the Army Air Forces. 

Mr. George B. Dantzig is now Principal vStatistician of the Army Air Forces 
Statistical Control Division at the Pentagon Building in North Arlington, Vir¬ 
ginia. 

Assistant Professor Preston C. Hammer of Oregon State College has taken a 
leave of absence to aid in setting up statistical methods of quality control for the 
Lockheed Aircraft Corporation of Burbank, California. 

Dr. Tjallmg Koopmans is now associated with the Cowles Commission for Re¬ 
search m Economics at the University of Chicago. 

Dr. Jerome C. R. Li is now an instructor in matlrematics at Queens College in 
Flushing, New York. 

Associate Professor Joe Livers of Montana State College has been granted a 
leave of absence for the summer and fall terms to study at the University of 
Michigan. 

Assistant Professor Eugene Lukacs of Illinois College, Jacksonville, Illinois, 
has accepted an associate professorship in mathematics at Berea College, Berea, 
Kentucky. 

Mr. R. I. Piper, who has been on leave from the Southern California Telephone 
Company to do war research at the California Institute of Technology, has re¬ 
turned to the Telephone Company as Plant Staflf Assistant. 

Dr. Henry Scheffd, formerly lecturer in mathematics at Princeton University, 
has been appointed to an assistant professorship in mathematics at Syracuse 
University. 

Assistant Professor H. M. Schwartz of the University of Idaho has been ap¬ 
pointed research fellow at the Bartol Research Foundation in Swarthmore, Penn¬ 
sylvania. 

New Members 

The following persona have been elected to memberahip in the Inatitute: 

Bower, O. K. Ph.D. (Illinola) Asao. m Dept, of Math., XJniv. of Illinois. 606 W. John, 
Champaign, Ill. 

Breden, Robert E. B.S. (Kansas Stale College) Peraonnel Technician, Statistical Serv¬ 
ices, Technical Section of the War Dept., 270 Madison Ave., New York, N. Y. 
Brixey, John C. Ph.D. (Chicago) Aaso. Prof, of Math,, Umv. of Oklahoma. 927 S. Pick¬ 
ard, Norman, Okla. 

Brown, Arthur B. Ph.D. (Harvard) Aaat. Prof, of Math., Queens College, Flushing, N. Y. 
Bruyere, Martha (Mrs. Paul T.) Stat., U S. Public Health Service, Div. of Venereal 
Diseasea, Gaithersburg, Md. 
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Bniyere, Paul T. M P.H. (Yale) Stat., TJ. S Public Health Service, Bldg. T6, Betheada, 
Md. 

Carter, Gerald C. Ph D. (Purdue) Dept Head, Naval Training School, Purdue Umv. 
530 Garfield St , W. Lafayette, Ind. 

Casanova, Teobaldo. Ph D. (New York) Res. Stat., Univ. of Puerto Rico, Rio Piedras, 
P R. 

Chances, Ralph. B B.S. (C C.N.Y.) Stat., Industrial Surveys Co., 347 Madison Ave., 
New York, N. Y. 

Cody, Donald D. A B (Harvard) Res Math., Res. Lab., Indianapolis Naval Ordnance 
Plant, Indianapolis, Ind. 

Duvall, George E. Asst. Physicist, UCDWR, U S Navy Radio and Sound Lab., San 
Diego 52, Calif 

Ellis, Wade. Ph.D (Michigan) Special Instr. in Math., Umv. of Michigan. 921 Wood- 
lawn, Ann Arbor, Mich. 

Field, Robert W. Ph.D (Illinois) Asso. Prof, of Industrial Engineering, Purdue Univ , 
Lafayette, Ind. 

File, Quentin W. Ph D. (Purdue) Instr. of Elec. Wiring, Purdue Naval Training School. 
Physics Bldg., Purdue Umv., Lafayette, Ind 

Freeman, Albert M. Dir. Math. Lab., Boston Fiduciary & Research Associates. Neck 
Rd , Tiverton, R. I 

Gerlough, Daniel L. B.S (Calif Inst, of Tech.) Quality Control Engineer, Plomb Tool 
Co., Box 3519, Terminal Annex, Los Angeles 54, Calif 

Germond, Hallett H. Ph D. (Wisconsin) Asso Prof, of Math., Univ. of Florida, Gaines¬ 
ville, Fla (On leave). 

Ghormley, Glen E. Stat Analyst, Lockheed Aircraft Corp. 139 N. Chester Ave., Pasa¬ 
dena 4, Calif. 

Grant, Eugene L. A M. (Columbia) Prof, of Economics of Engineering, Stanford Univ., 
Calif. 

Gunlogson, L. S. B B.A. (Minnesota) Ensign, USNR 3616 18th Ave , So,, Minneapolis 
7, Minn 

Hart, Alex L. Ph D. (Minnesota) Asst, to the Dir , Res. Dept., Eastern Air Lines, Inc. 
141-24 79 Ave , Flushing, L I , N. Y. 

Kefferstan, William F. Mgr., Economic Research, Boston Fiduciary & Research Associates, 
50 Congress St., Boston, Mass 

Lyons, Will. B Sc (Bucknell) Economist, Gen Statistics Staff, W.P.B 2027 Park Rd., 
N W , Washington 10, D, C. 

McBee, Ethelyne L. M A (Columbia) Stat , Dept of Agnc 2126 N Stafford St., 
Arlington, Va 

McIntyre, Donald P. M A. (Toronto) Meteorologist in Charge, Prince George Airport 
Box 296, Prince George, B C , Canada. 

Moss, Judith. BA (Vassar) Jr. Math , Stat. Res. Group, Div, of War Research, Columbia 
Umv, 319 St John's PI , Brooklyn 17, N Y 

Oosterhof, Willis M. M.A (Michigan) Stat , Mich State Dept, of Social Welfare 
811 Hackett St., Ionia, Mich 

Piper, Robert I. BA (Montana) Res. Asso. Room 204, Astrophysics Bldg , Calif. Inst, 
of Tech., Pasadena 4, Calif. 

Robbins, Herbert E. Ph D (Harvard) Lt., USNR. Post Graduate School, Annapolis, 
Md. 

Seeley, Sherwood B. Ch E. (New York) Dir , Res and Tech. Div , Joseph Dixon Cru¬ 
cible Co., 167 Wayne St , Jersey City 3, N. J 

Simpson, Tracy W. E.E (Armour Inst of Tech ) Sales Promotion Mgr , Marohant 
Calculating Machine Co. 2903 Forest Ave , Berkeley, Calif 

Smith, Edward S. Ph D (Virgima) Prof, of Math , Univ. of Cincinnati, Cincinnati 21, 
Ohio 

Waksberg, Joseph. B S. (C C.N Y ) Economic Analyst, Bureau of the Census, 1422 
Saratoga Ave., N E , Washington 18, D, C. 



REPORT ON THE WELLESLEY MEETING OF THE INSTITUTE 


The Seventh Summer Meeting of the Institute of Mathematical Statistics was 
held at Wellesley College, Wellesley, Maas., on Saturday and Sunday, August 12 
and 13, 1944, in conjunction with the meetings of the Mathematical Association 
of America and the American Mathematical Society. The following 51 members 
of the Institute attended the meeting: 

T. W. AndorBon, H. E Arnold, K. J. Arnold, L. A. Aroian, A. L. Hailey, J. L. Barnes, 
C. I. Bliss, A. H. Ilowker, B. II. Camp, G W. Churchman, W G. Cochran, T, E. Cope, 
J. H. Curtiss, W. E, Doming, P. S, Dwyer, Will Toiler, C D. Perris, R. M. Foster, 
H. A, Freeman, Henry Goldberg, E. J. Gumbol, P. R. Halmos, Harold Hotelling, Truman 
Kelley, L. R, Klein, Myra Levine, John Mandel, J W, MaueJily, Richard.v. Mis^s, 
E. B, Mode, Vaclav Myslivec, P. M. Neurath, M. L. Norden, C. 0. Oakley, P. S. 01m- 
stead, Edward Paulson, Win, Reits, S, L. Robinson, F. E. Satterlhwavte, Henry Sohe£F6, 
W. A, Shewhart, Andrew Sobszyk, H. W Sloinhaus, Marian Torrey, Mary Torrey, A. W. 
Tucker, J W, Tukey, Abraham Wald, R. M. Walter, Elisabeth Wilson, Jacob Wolfowit*. 

The first session was held jointly with the Mathematical Association and con¬ 
sisted of a Symposium on “Potential Opportunities for Statisiicians and the 
Teaching of StatiKtics.” The PrcHident of the Institute, Dr. W, A. Shewhart, 
presided. The principal addresses were made by I.)r. Shewhart and Professor 
Harold Hotelling. Remarks were also made, upon invitation of the Chairman, 
by Prof. Milton de Silva Rodrigues of Sao Paulo University in Brazil who is 
spending a year in studying methods of teaching statistics in this country, and by 
Dr. Vaclav Myslivec, Czechoslovak Delegate to the United Nations Interim 
Commission on Food and Agriculture. A lively discussion was under way when 
time forced the conclusion of the meeting. There was contimietl discussion by a 
smaller group for some time afterwards. 

Professor B. H. Camp acted as Chairman at the Sunday morning session, a 
contributed papers session held jointly with the Association. The following 
papers were presented; 

1. Statistical Tests Based on Permutations oj the Observations. 

A, Wald and J. Wolfowitz, Columbia University., 

2. Error Control in Matrix Calculation, 

P. E. Satterthwaite, Aetna Life Ineurance Co. 

3. On Cumulative Sums of Random Variables, 

A. Wald, Columbia Univereity. 

4. The Approximate Distribution of the Mean and of the Variance of Independent Varu 
ales. 

P. L, Hsu, National University of Peking. (Introduced, and presented, by W. Feller, 
Brown University). 

6. Ranffes and Midranges. 

E. J, Gumbel, New School for Social Research. 

6, iSfatielicB of Sensitivity Data, II. Preliminary report. 

C. W. Churchman, Frankford Arsenal and Benjamin Epstein, Westinghouse Electric 
and Manufacturing Co. 
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President Shewhart presided at the Sunday afternoon session, The follow¬ 
ing invited addresses were given: 

1, The Problem on Tolerance Limits. 

Lt. J. H. Curtiss, USNR. 

2, Some Improoemenls in l^eiikng mi Other Experimental Techniques, 

H. Hotelling, Columbia University. 

A business meeting was held at the conclusion of the Sunday afternoon session. 
The Secretary-Treasurer made a brief report dealing with (1) the financial condi¬ 
tion of the Institute and (2) the membership growth of the Institute. The Pres¬ 
ident, reporting for the Editor, indicated a need for more papers for the next 
two or three issues of the Annals. The Institute, after some discussion, then 
passed two Amendments to the Constitution and four Amendments to the By- 
Laws. These Amendments are listed in the following section. A resolution 
thanking the officials of Wellesley College was passed. 

A dinner for the three mathematical organizations was held Sunday evening, 
Addresses were made by Captain Mildred H. McAfee and Professor Marshall H. 
Stdne. Later in the evening there was a musicale featuring David Barnett. 

P. S. Dwybe 
Secretarj/ 



AMENDMENTS TO THE CONSTITUTION AND BY-LAWS 
OF THE INSTITUTE 

The following Amendments to the Constitution and By-laws were passed at 
the business meeting at Wellesley College on August 13, 1944. The votes of all 
voting memlwrs who sent ballots to the Secretary-Treasurer prior to the time of 
the meeting were eountf'd in the balloting. The Amendments as adopted are 
identical with the proposed Amendments which were placed in the hands of the 
membership in July; 


Amendments to Constitution 

1. Article III. 3, Tha first sentence, which was 

"The Institute alvall have a. Committee on Memtxirahip composed of three Fellows.” 
shall be revised to read: 

"The Institute shall liave a Committee on Memt>erBbip composed of a Chairman and 
three Follows.” 

2. Article IV. 3, The first two sentences, which were: 

"The Committee on Membership shall hold a meeting immediately after the annual 
meeting of the Institute. Further meetings of the Committee may be held from time to 
time at the call of the Cliairmnu or any memberof the Committee provided notice of such 
call and the purpose of the meeting is given to the, members of the Committee by the 
Scorctary-Treaaurer at least five days befon* the dale set therefor.” 
sluill be revised to road: 

"Meetings of the Conmuttoe on Membership may Ise lield from time to time at the cell 
of tha Chairman or any member of the Comraitlee provided notice of such call aud the 
purpose of the meeting is given to the members of the Committee by the Secretary- 
Treasurer at least five days before the dale set therefor. Committee business may also 
be transacted by correspondence if that seems preferable. 

Amendments to By-Laws 

1. Article I. 4. Add the following sentence: 

"The power of election to the different grades of Memlmrship, except the grades of 
Member and Junior Member, shall reside in the Board.” 

2. Article I. 5. which was' 

"The Committee on Membership shall prepare and make, available through the Secre¬ 
tary-Treasurer an announcement indicating the qualifications requisite for the different 
grades of membership." 
shall have added the following sentences: 

"The Committee shall review these qualifications ponodioally and shall make such 
ohanges in these qualifications and make such recommendations with reference to the 
number of grades of membership as it deems advisable. The power to elect worthy 
applicants to the grades of Member and Junior Member shall reside in the Committee, 
which may delegate this power to the Secretary-Treasurer, subject to such reservations 
iis the Committee considers appropriate. The Committee shall make recommendations 
.0 the Board of Directors with reference to placing members in other grades of member- 
,jip. The Committee shall give its attention to the question of increasing the number 
of applicants for membership and shall advise the Secretary-Treasurer on plans for that 
purpose.” 
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3. After Article II. 1(a) Exception. Add: 

“(b) Exception. Any Member or Fellow may make a single payment which will be 
accepted by the Institute m place of all succeeding yearly dues and which will not other¬ 
wise alter his status as a Member or Fellow. The amount of this payment will depend 
upon the age of this Member or Fellow and will be based upon a suitable mortality table 
and rate of interest, to be specified by the Board of Directors.” 

and 

4. “(c) Exception. Any Member or Junior Member of the Institute serving, except as 
a commissioned ofiScer, in the Armed Forces of the United States or of one of its allies, 
may upon notification to the Secretary-Treasurer be excused from the payment of dues 
until the January first following his discharge from the Service. He shall have all privi¬ 
leges of membership except that he shall not receive the Official Journal. However during 
the first year of his resumed regular membership he may have the right to purchase, at 
S2.60 per volume, one copy of each volume of the Official Journal published during the 
period of his service membership." 



ABSTRACTS OF PAPERS 


PreBent^’d on Aiiguht 13, HM4, at the WclloHley inwting of tlu* InBfcitutc 

1. Statistical Tests Based on Permutations of the Observations. A. W.vi.d and 
J. Woi/FOWiTZ, Columbia Univor.Bity. 

It wan jxtiiilpil ovit by Fisher lhai Htaliatienl lestH of esart wire, lamed on permutations 
of the obwrvttliouH, ran Iw earned out vtithout imHuming anything altout the, underlying 
distTibutions except their contimivty Srhe(T6 lum proved that, for an important class of 
hypotheseH, thew' tests are I he only ones with n'Kions of exact sue. Texts based on permuta¬ 
tions of the ohmmvalioiw Iiave Isjen eoustrueted by Fisher, Filiimii, Welch, and the present 
authors. In the present ivajxir, the ivutliora prtive a llumn'in on tile limiting normality of 
the distribution, in the universe of jiermutations, of a class of linear forms ‘Application 
of this theorem gives tho limiting normality (in the nmverae of ]MTmutatiuns, of course) 
of the correlation wnirient, and of a slatistie inlrodiieed by Pitman to test the difference 
between two meaus. Tho limiting dmlrilnitioii of the iinnlysm of vtirianee statiatie in the 
universe of permutations is nlso obtained. 

2. Error Control in Matrix Calculation. Fhankmn K. SAri'BUTHW vitk, Aetna 
Life In.Miranco Co 

The arithmetie evaluation of nmlrix expressions is often mtber eomjdieated. One of the 
causes of this is the fact that relatively minor errors (such as rounding I'rrors) introduced 
in an early step may bi* magnified to such an extent in Hueceednig slops tlmt tlio fimil result 
IB useless. Ilemtlve methods to meet this difliniilty have lieon reviewed very completely 
by notelling, In this jiaper a. diffenmt approach is taken, f'oiiditioiis mi the norm of a 
matrix are determined so tliat a Ihxilittle proeeas will not magnify errors to more than two 
or three decimal places It is then pointeil out limt if an appmxiination to the inverse of 
the matrix is availahlc, most problems can lie rearranged so tliat the required norm conditions 
are met, A Doolittle process may then Im* used to any number of cleeirmil places with as- 
Buranee that errors will not accumulate to more than a limited number of decimal places. 

3. On Cumulative Sums of Random Variables. A. Wald, ('olumbia University. 

Let (r,| (t “ 1,2, ad inf.) be. a scciueiice of inde.jieiulent random variables each having 
the same distribution. Denote by 7i, the, sum of the first; elemeulB of the sequence. Let 
o > 0 and 6 < 0 be two constants and denote by n the sraallest integer for which either 
Ifn ^ aor Z„ < 6, Neglecting tho quantity by which Z„ may differ from a or 6 (this can be 
done if tho mean value of |z,| is small), the probability tliat Kn S; e for c « a and c =« 6 
is derived, and the characteristic function of n is obtained The probability distribution of 
n when zi is normally distributed is derived. These results have appUeation to various 
Btatistical problems and to problems in molecular physics dealing with the random walk of 
particles in the presence of absorbing barriers. 

4. The Approximate Diatributiou of the Mean and of the Variance of Indepen¬ 
dent Variates, P. L. Hau, National University of Peking. 

Let A^be mutually independent random variables with the same cumulative distribution 
funotionj let JS(Xi) “ 0, E{Xl) »• 1 and jE!(Al) >« S. Finally put S -• n"i X^k-i 
ii — n"' (A* — 5)L The author first gives a now derivation of H, Cramer’a well- 

known asymptotic expansions for Pr (n^S < a1. The proof is much more elementary and 
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avoids in particular the use of M Riesz’ singular integrals, Instead a considerably simpler 
Cesaro-type kernel is used, which has first been introduced by A, C Berry {Trans, Amer. 
Math Soc 49 (1941), pp 122'136). The same method is then used to derive similar asymp¬ 
totic expansions for Pr (n*(i? “ 1) < ~ I)*!®) The method can be extended to the case 

of unequal components and also for the study of other functions encountered m mathematical 
statistics 

5. Ranges and Midranges. E, J. Gumbel, New School for Social Research 

The mth range w,n and the mth midrange Vn are defined as the difference and as the 
sum of the mth extreme value taken in descending magnitude ("from above”) and the 
mth extreme value taken in ascending magnitude ("from below”) The semi-invariant 
generating functions L„(l) and mi(i) of the mth extreme values from above and below are 
simple generalizations of the semi-invariant generating functions of the largest and of the 
smallest value which have been given by R A Fisher and L. H. C Tippett. If the sample 
size IS large enough the two mth extreme values may be eonsidered as independent variates. 
Then, the semi invariant generating functions i»(<, m) and Z/„(^, m) of the mth range and 
of the mth midrange are 

L«(i, m) = Lm(i) + m) = ^»{t) + ni(<)- 

If the initial distribution is symmetrical the semi invariant generating function of the mth 
range is twice the semi invariant generating function of the mth extreme value from above. 
The distribution of the mth range is skew, whereas the distribution of the mth midrange is 
of the generalized, symmetrical, logistic type The even semi invariants of the mth midrange 
are equal to the even semi invariants of the mth range For increasing indices m the distri¬ 
butions of the mth extremes, of the mth ranges and of the mth imdranges converge toward 
normality. 

6. Statistics of Sensitivity Data, II. Preliminary report. C. W. Churchman, 
Frankford Arsenal, and Benjamin Epstein, Westinghouse Electric and Manu¬ 
facturing Co. 

In this paper a study is made of the distribution of the first two moments of sensitivity 
data as functions of the sample size The chief results are briefly these; 

(a) The distributions of i and A (for definition of these functions, see "On the Statistics 
of Sensitivity Data,” by the authors in the Annals of Mathematical Statistics, Vol. 
XV, No 1) approach normality rapidly as functions of the sample size; 

(b) i and vi are “almost” independent even for small sample sizes, thus justifying the 
use of Student’s ratio in texts of sigmficance for differences between two sample 


means 




SOME EXTENSIONS OF THE WISHART DISTRIBUTION' 

T. W. Andehson and M. A. Girshick 
Princeton University and Columbia University 

1. Introduction. The well-known Wishart distribution is the distribution 
of the variances and covariances of a sample drawn from a multivariate normal 
population assuming that the expected value of each variate remains the same 
from ohsei'vatron to observation. For problems such as testing collinearity [1], 
comparing scales of measurement [2], and multiple legression in times series 
analysis [3], it is desirable to have the distribution of sample variances and co- 
variances for observations, the expected values of which are not all identical 
Such a distribution could be considered as a generalization to several variates 
of the (non-central x^) distribution, as well as a generalization of the Wishart 
distribution to the non-central case In this paper we shall discuss the general 
problem of finding the distribution m question and shall derive this distiibution 
for two particular cases. We shall start out with the problem in its moat general 
form and as a result of linear transformations express the distribution as a certain 
multiple integral 

We can think of the expected values of the observations as defining points in a 
space of dimension equal to the numbei of variates. If these points lie on a line, 
the non-central Wishart distribution is essentially the Wishart distiibution 
multiplied by a Bessel function; if the points lie in a plane, it is a Wishart distii- 
bution multiplied by an infinite series of Bessel functions. For higher dimen¬ 
sionality the integration of the multiple integral becomes extremely troublesome; 
it has not been possible yet to express the general integration in a concise form 
These results are summarized precisely at the end of the paper. 

2. Reduction to canonical form. Consider a set of N multivariate normal 
populations each of p variates Let the ith (z = 1, 2, • • , p) variate of the ath 
(a — 1,2, ■ • ■ , N) population be Xia ; let the mean of this vaiiate be 

(1) = M.« (i = 1, 2, • ■ • , p; a = 1, 2, ■ ■ ■ , A); 
and let the variance-covariance matrix (of rank p) common to all N distributions 

' be 

II .^[(^)O Uta^iXja Mja)] II ~ II •T'l II (® ~ 1) 2, ' ' • , N), 

Now consider a sample of observations {xm) one from each population. 

The purpose of this paper is to find the joint distribution of the quantities 

N 

(2) O.J = S (x,B - X.)(a;ja - ■«;), 


‘ The results given below were arrived at independently by the two authors. Some 
preliminary results were given before the Institute of Mathematical Statistics at Wash¬ 
ington, D. C , May 6,1944, by Girshick. 
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1 V 

■r< ~ -.v 2L, •<".» • 

.V o„l 

To 8irii]ilify tlir iiotntinu in the %voik wo treat tlit‘ riuantities a,-, 

instead of tho satnple variances ami covariances whicli an* simply multiples 
(by 1/(.V - U) of tile «i,. 

Tlio n,, may be considiTcd as sums of snuares anti cross protlucls, for there 
exists a linear transformation^. 


where the, matrix |j Oa:) is orthogonal (iiml ffvi - fl.vs 
such that 


(f == 1, 2, • ■ • , p), 

= 0 A-.V = 1/VN), 


TT / / 


where rt = A’’ — 1 tuul 


'JV .CiXj “ . 

For a fdvoii a the a-I,, have a mnllivariaft' noiinal distribution with the .same 
variances and covariances a.s the j’s anil wifli (“Xiiecftsl values 

“ 23 f'oflt'.ff “ I say. 

S-i 


L / / 

a*-l 

Then it is clear tliat the r,, are the .same func.tion.s of the pH that the a,/ are of 
the x's, namely, 

(3) Tij = 23 ( m .« “ /i.)(nya — fij), 

c — l 


1 ^ 

Mi = vy 23 M(« . 

iV 0-1 

Now consider tho two p by p rnalricea 

S “ II <ro II 


T - ||r.7l 


* See, for example, [4]. 
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Let /Cl, K 2 , • • • , Kp be the real, non-negative roots of the determinantal equation 

(4) 1 T - XS 1 = 0. 

There exists a non-singular by p matrix 

(5) = II II 

such that* 


( 6 ) 

and 


(7) 


= I 


2 

Kl 

0 • 

0 

0 

2 

Ki ■ 

0 

0 

0 • 

2 

* * up 


where 1 is the identity matrix and ’i'' is the transpose of Suppose the rank 
of T IS then t of the roots are non-zeio and p — t are zero. For the sake of 
convenience we shall choose k? , kI , • • • , k 5 to be the non-zero roots If T is of 
rank t, then the means ju.a lie in a t dimensional sub-space of the original p 
dimensional space. Let us make the transformation 


( 8 ) . 

The 2,a are normally and, because of relationship (6), mdependently distributed 
with unit variances. The mean value of 2 ,a is 


E(2»a) — 'I'xiIJ’ja Vxa , 

3-1 


say. As a result of (7) 



(9) 

n 

2 2 

2^ 

a»I 

(z = 1, 2, • ■ •, p), 

(10) 

n 

VxaVja. — 0 

^ j)- 


a—1 


Let the new sum of squares of cross-products be 

n 

(11) bij = Xv 2,0 2,a . 

0=1 

We shall first find the joint distribution of the 6„ and then obtain the distribution 
of the a,, by using the fact that the bxj can be considered simply as a linear 


See, for example, [5]. 
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tmngforirmtion of the o,, in a 4- 1) (iiniensional Bpace, For wc can write 
bi/as 

nr P 

( 12 ) ™ ^th^jk^hh • 

a**! AiJlnl 

7’he traiisformation (8) is performed on all variates of each oliaervation. The 
next tnuiBfcinmitioii, whieli is the one that results in the canonical form of the 
problem, is performeil on all oliservations of each variate. We wish to construct 
th(> n by n matrix of this transformation 

= II II 

in the following manner; I^ct 

‘/',a = “ (« = 1, 2, ■ ■ ■ , n; r; = 1, 2, ■«• , i). 

In view of (9) and (10) 

n 

£ 4>i‘> <!>,«“«{,. (£. P == 1) 2, • • • , 0 

a_l 

where 5i, is the Kronecker delta. The remaining elements in 4 are chosen in 
any way to make 4’ orthogonal. 

Now make the transformation 

n 

Vio = S (i = 1, 2, • • • , p; a( =» 1, 2, • • • , n). 

(j-i 

Because $ is orthogonal, 

n 

(13) b(j “= 23 

(■•kI 

and the y’s are independently normally distributed. By virtue of the construc¬ 
tion of $ and the properties of || »»(„ || the expected value of each is zero except 
for i of the variates, namely, 

^(y«) = *» (y == 1,2, • ■ •, 0, 

Now the problem can be put in this form: Find the distribution of bn (given by 
(13)) when the distribution of the y's (in the canonical form) is 

1 -1 2 55 

(27r)'’"« ' 

whore /ci, kj , ■ ■ • , Xi are different from zero. 

The solution of our problem can be expressed as a certain multiple integral of 
ip variables, Let 

n 
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Since the have the Wishart distribution with n — t degrees of freedom (we 
assume n > « + p) we can write the joint distribution of the and (i = 
i-* * *' j P3 V 2 , * ■ ■ ft) as 




I J(n-p-<-l)g .,,-1 


j> I 

1 -i S S (i/<i|-'i|*ii|5* 
X 


(27r)J’‘'2 


Considering the equations 


= b'-y + E 2/11? 2 /jn 
1—1 


as a transformation of the b[, we immediately obtain the joint distribution of the 
b’s and the = 1, 2, • • • , p; d = 1,2, • • • ,t)&B 


-JS«? 


1”! 


(14) 


2iP"^jpu>-i)+b» _ ( + 1 _ i]) 


\b.i - E- - 


IT—I 


2/*i Vin I 


X e 


p * 

-1 S !>«+ 2 


To find the distribution of the bi, we must integrate out the y,,, where the 
range of integration is such that the matrix 

t 

ll&.y - E2/(,yyJI 

il-l 

is positive. For t = 1 or 2 we can integrate (14) and express the results in a 
convenient form. However, for higher values of t the integration affords con¬ 
siderable difficulty and has not been done for the general case. In terms of 
geometry the case f = 1 is the case in which the expected values of the observa¬ 
tions lie on a fine in the p dimensional space. In the case of f = 2, similarly the 
expected values fie in a plane in this space. Hence, we shall call these two cases 
the linear and planar cases, respectively. 

3. The linear case. In the linear case there is one root of the equation (4) 
which is not equal to zero, that is, there is simply one k in the distribution (14) 
and one set of y’s, namely p,i(f = 1, 2, ■ ■ • , p). The problem is to integrate the 
yii over the range for which the matrix 

\\K - VaVii II 
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ift poKitivf*; the integrand we are interested in is dlropjjing tiie suliKcript “1” 
from llie ki and y,i and neglecting the part, not invnlvniK the y's) 


i “• !h 


S' «l^i 


II du. 

iWM I 


The deWrminant in ('xpiession (In) can lie exprewHid as 


■*ij yii/i i ■“ ' I ih !t^ I 


I!/'";: - 

Tlu“ inverse exists lieeaiusc' the prnhatiilitv is zero that jj b,, i| is .singular. There 
i.s a linear transfnrnuition 


such that 


!/\ ~ S U<i > 


Z /'"'/it/j Z 

I.J~1 /~1 


X//1 - /«! , 

where t' i.s tlie. one non-zeui root of the equation: 

(10) 1 Mi ' - >?Kyi I =- 0, 

whore B ' = |1 1| and A'u is the matrix with unity in the ipipei’ left liaiid corner 

and zeros elsewhere. This fact is a result of the well-known theorem eoncerning 
diagoiuilization of pairs of (inadraiic fornus.'' TheJaeohian of thi.s traii.sforination 


I 3 o I = I b„ |‘, 

and the range of integration i.s Z ^ 1- The integrand is tuuisfoimcd into 

I «w I 




I' \ i(« lJ-21 


e'“‘ IldUi. 

1-1 


Now lot 


U\ ~ MU W, 
n, ~ eos w V, -i 


n, ~ eos wv,.i (i = 2 , 3 , • • ■ , p) 

* The tianaformation is the ao-eallecl “regrc.s.sion Iraii.sformation " See Madow [6] 
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The Jacobian of this transformation is cos'’ w and 

1 — wj = cos* ^1 — ^ ■ 


The integration is over the ranges of ^ ^ and 


E < 1. 


I 


We integrate the following expression 

K P-t \Kn-p-2) ~\ 

1 - n dy.J (cos" we ““dir). 

The integral of the quantity within the brackets is simply a Dnichlet integral [7] 
and its value is 

r(|[n - 

r(Mii - 1]) ■ 


The integral of the expression within the braces is a multiple of a Bessel function 
of purely imaginary argument [8, p 79]; that is, 


r(^[n - 1])VTT 
(f/2)n'-« 


(1)- 


Hence, the integral of (15) is 

(17) I K |“"“'’"”r(Mn - p])w*'’(l/2)-*‘"-*>7|(„_2)(0. 

Multiplying equation (16) by the determinant |B| one can easily show that the 
non-zero root, I*, is simply K*bii. The distiibution of the b,, in the linear case 
then is 


-} 2 I’ll 

__" ^ ^- I b„ I ‘<’'^*’-”(Al)“‘'"“*'/l(n-2)(xV'^), 

2ipr.-i(p-2)^lp(p-l) ^ 

1=1 

In §5 we shall give the distribution in terms of the original variables, namely, 
the Hi) . 


4. The planar case. The case of two non-zero roots of equation (4) can be 
handled by continuing the process of integration of §3 another step. The 
essential problem is the integration of 


K - 


2 


E 




P 2 

i(--p-3)g«lini+<2P22 JJ JJ 

1 = 1 TJ=l 


(18) 
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over the ran go of i/'ft for which the matrix 

a 

ii hjj 5Li iliiVh ll 

1)—I 

18 positive. The intcKratinn is clone in two stages, first with respect to the y,i, 
then with respect to the i/.n. Ivetting 

jX = n X, 


I = *1, 


i/f ~ ?/.i, 


and omitting for the time being 

(19) e”"” li diM, , 


we can write tlie first stage of the integration of (18) a.s 

[ \K “ .vcy/I’i'/i/c 

J I*-*! 

over the range || Sa — y<gi || pewitive. But, tlie only difference between this and 
the integration of (16) which has lieen shown to ho (17), is that we are now writing 
all variables with signs. Keeping thi.s in mind, changing hack again to 
our other variables of Section 4 and inserling again (19) we ean write the first 
stage of the integration of (18) as 

r(Mn - p - iDrr*'’ 1 b.v - 

'/Urt--3)(V Kl&ii — KlZ/l?) IT ^2 /i2 • 

i«*l 


Now we must integrate (20) with respect to the t/.j over the range || h,, — 2 /, 22 /j 2 )) 
positive. The determinant in (20) can be written as 

I b.yl ^1 - 2^ V‘^y<iys^ • 

There is a transformation 


(21) 

1 /it ^ Z. OihV > 

such that 

i i*'y{iijj2 - is), 

i.;-l )-J 

AlZ/lS ~ f Si , 

(22) 


«2y22 = cfisi + ^283 
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where f is the one non-zero root of the equation 

I - K\En I = 0, 

where and En are used as in equation (16). Since this equation 
is similar to (14), then/ = k?5ii . The values of di and da will be considered 
later. This result is deduced from an extension of the theorem concerning the 
diagonalization of pairs of quadratic forms.* The Jacobian is 

I ff.i I = I 

P 

and the range of integration is 2 ^ 1* The integrand (20) is now changed to 

1-1 

/ p \J(n-p-2) 

r(Mn -P - l])x‘^ 1 I (l - E si) 

.[ al z (v/d - sD) n ds,. 

Next the following transformation is made: 


Si = sm lOi, 

82 = COS Wi sin , 

8, = COS Wt cos w,_* (f = 3, 4, • • • , p). 

The Jacobian is cos” wi cos””*n; 2 , and 

1 — ^ 8? = cos’* wi cos® 1112 ^1 — ^ . 

We now integrate 

K P-2 \1("-P-W P-2 q 

1 - E n dv,^ 


(23) 


cos""® WI cos""’ 




(/cos 

■J{(„_a)(/ cos Wi) dWi diUsl. 


The integral of the expression within the square brackets is another Dirichlet 
integral; its value is 


r(Mn - p])2r*^”-®> 
r(Mn - 2]) 


‘ Again the “regression transformation” is used. See footnote for Section 3. 
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Similar to Section 3 tlic iti<<‘giation of (he (nmntity within tlie lirace.s with respect 
to tui ia 

r(Mn “ WVtt (dj cos W'l) 


rt—3 >ii fii 

MKKS ‘ 


( 2 ^''J ^Kn-vCf COS Wl). 


Since the range of inlcgnition of u'l ia 7r/2 < ici < 7r/2 and .since .sin Wi i.s an 
odd funclion and t:o.s i/'i i.s an (‘ven function, the iiitegfal of the aliove expre.s.sion 
can he tran.'-fornieil into an inh'grafion over tlie iinige 0 < rci < ir/2 liy replacing 
c'*‘ hy 2 .sirih (di .Nil lOi], In view of the relatioii.ship hetwc'en the, Bessel 
funetion.s of jnirely imaginary argument and .sinh (di .sin i/'i) [3, p. 54] we ean write 
the integral of the aliovo expression as 

A> \-Kn-.n 

rain - 2])V^(jj VdIV'27r 

rWS 

X / /..[(di .sin (ci)/ii„ ,)((/« eo.s iei)/|t„ }>(/ cos iim) .sin J u'l co.s Wi duh . 

Jo 

Tliis integral can he cx[)rc.‘'scd in another form liy virtni' of a fonnnla in Watson's 
Brsscl Funrluniit [X, ji. 377) tus 

(211 2“" ” r '^1"'- + d; + f ~ 2,hf CO.S u) 

^ ‘ (d'{ + d; -I-/ ~ 2i/o/eo.s Ml’'" =’ 

lAstting d* + da -t- f ■- .r and (kj ■- y and u.sing an exjire.sioii foriinila for Bessel 
functions (8, p. 140] we cun write (21) a.s 

Vi 2''"-' sin-’udu. 

vQ 7»»>U “y' 

Since the integral of co.s’’ m sin"' ’a wlii're')' i.s odd is zi'ro, the, re.snlt of the integra¬ 
tion (using the “duplication formula’’ for P functions and if’tting y — 2w) is 

” C,|2\U ■ i(n 2/i:u 

mn - 21),r2'<" iVx). 

From the relationship (22) it is clear that the* eipiation 

(26) I >.%,■ - X6'’ I - 0 («r =- 0 for i -- 3, 4, ■ • • , p) 

IS traiisforincd hy (21) into 

/" 4- di — X djdj 0 ■ • t) j 

dida da - X t) • • • 0 

0 0 ~x ... 0 


0 0 
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Expression (25) is equivalent to 

(27) I - \S„ 1 = 0. 

Hence, x and which are the sum and product, respectively, of the non-zero 
roots of the two equivalent equations (26) and (27), are given by 

X = f di dt — Klbu + K2f»22 , 

y* = fdl = KlKlihnb^ - b\,). 

In view of this result we can now write the integration of (23) as 

r(Mn - p - l])r(Hn - p]) 2 r^ 2 *<"-^>| 6 .,p'’-'’-‘> X E 

•(/Clftn + /C 2622 ) ^^“^°“'7un-2)+2u('\/)£i5n Kjftjj)- 

Finally, by multiplying in what was left out of (18) we obtain the integral of (14) 
which is the solution to the problem as stated in the canonical form: 

\ 

P 

(28) H min - 1 - il) 

(Klbn + 4622)-*'''"-*>^'“’ 

a - 1 \ 

-r- +") 

X 7t(n-2)+2u(\/jCl 611 -f- K2bi2)- 

B. Final form. To answer the problem as stated originally it is necessary to 
make the transformation (12) and obtain the distribution in terms of the o„ for 
the linear and planar cases. 

It IS clear that equation (25) is equivalent to 

(29) I T ~ I = 0, 

where = 1| a„ |p\ for T is the transform (by (5)) of || /c?6,, || and is the 
transform of jj b., 1| The sum and product of the non-zero roots, which are the 
arguments of the infinite senes in (24), remain unchanged 

P 

Since the quantity E fhe sum of the roots of (4) it can be expressed as 

1—1 

E = E Ecr’^(f*.a - /I.)(M/a- M,). 

i-»l a«>»l 

where || o-*-' 1| = || o-,, ||'\ Furthermore we have 

1 I ~ 1 ^ I ■ I **‘3 I 


00 r 2 2/1. 
“”‘’2=“co!r(’' 
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and 

E = tr II ba I! = tr ('!> i! o.,-1! = t «./• 

1-1 i.;-l 

Moreover, the Jacobian of tfie tranaformation (12) is* 

(30) I J( = 1^1'’“ = isr*'"’-"’. 

Hence, we have the following results; 

tJii'eii N muUimriale normal populalions each of p variates xuilh identical variance- 
covarianre. matrices |( a-,', (| and with expected values of the, pN variates X{„ given 
by (1). Let a,, be defined by equation (2); let the rank of the matrix jj r,', |1 defined 
by (3) he t. 

(i) When t = 0, the joint distribution of the a,y is given by the Wtshart distribution. 

(ii) When i = 1, the joint distribution of the a„ is 


2la(v-n-K,v_a) ^ip(p-i) g j 

1-1 


(31) 


X e 'Tee a. 7 (M(« — l<.)(My« “ i*/)! 

“-1 J 

X 22 " pi.) (Mia “ Mi)^' 


-I(V-J) 


(iii) When t ~ 2, the joint distribution of the a,/ is given by 

g _ 2 - f]) 

<-i 


(32) 


-I I; cHnfj 


X c './-I 
X /|(w-i)+iu('\/'Ui + th), 


___ 


(«I + 


where ui ond Ut are the two non-zero roots of (29). 

(iv) When t > 2, the joint distnbulim of the a,, can he written by means of 
expression (14) as a multiple integral. The explicit form of the distribution has not 
yet been obtained. 


* One method of demonstrating this fact is to ajiply (8) to centrally distributed variates 
and compare the Wishart distribution of the transformed variates with the Wishart dis¬ 
tribution of the original variates. 
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STATISTICAL TESTS BASED ON PERMUTATIONS OF THE 

OBSERVATIONS 

A. W.\I.D AND .1. WODFOWITZ 
(^olnmbia Univcrdly 

1, Introduction. Om* of tho problems of staiistioal inference is tn devise exact 
test« of siKnificance when the form of the underlying probability distribution ia 
unknown. The idea of a general rnellvod of dealing with this problem originated 
with R. A. Fisher [13, 14], The essential feature of this method is that a certain 
set of permutations of the. observations i.s eotwidered, having the firoperty that 
each permutation is efiually likely under the hypothesis to lie te.sterl. Thus, an 
exact test on the level of aignificanee a ean be eonstrueted by ehofwing a propor¬ 
tion a of the permutations as critical region In an interesting paper II. Rchelld 
[2] has .shown that for a general ckuss of problems this vs the only possihle method 
of constructing e.xact te.sts of .rigniticanee. 

Tests based on permutations of flu* observations have been proposed and 
studied by 11, A. Fisher, hi. ,1. Cl. hitman, B. L. Welch, the jire.scsit authors, and 
others, Pilman and Welch derived tlu* iirsl few moments of the .statistics irsed 
in their test procedures. IIoNvever, it is di'drable to derivt* at least the limiting 
diiStrihution.s of these statistics and make it practieahlo to carry out tests of 
sigiudcaiu'c when the sample is large, Hueh a large sample distribution was 
derived for a statistic corusidered olsowhero [1) by the jiresi'iit authors. 

In thus paper a general theorem on the limiting distrilmtion of linear forms in 
the universe, of permntiitionH of the obHervalioius is ih'rived, As an application 
of this theorem, the limiting disirilMiiions of the rank cori’clation coeificient and 
that of several statistics considered by Pitman and Welch, are obtained, In the 
last .section the limiting di.stribution of Hotelling’s geiu'ralizcd T in the univer.se 
of pemiutatioius of the (.ibsoiu'ations i.s derived. 


2. A theorem on linear forms. r.et //.v ~ Oh, hi ... Av) (W = 1, 2, . , ad 

inf.) be sotiuences of real numlu'rs and let 

= N-^ t ((/•« - t h) 

a-l \ B-l / 

for all integral values of r. We deiinc the following .symbols in the, cu.stomary 
manner: For any fiinellon f{N) and any positive funetum <p[N) let JiN) = 
Oi<p(N')) mean that \fiN)/ip(N) [ is bounded from aluivc for all iV ami let 


mean that 


m) - iiop(N)) 

m) = (Mm) 


lim;v inf | f(N)/vim I > 0. 
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and that 
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Also let 


mean that 


m = o{<p{N)) 


lim fiN)MN) = 0. 


Let [p] denote the largest integer < p 

We shall say that the sequences//wCTV = 1, 2, • • , ad inf.) satisfy the condition 
W if, for all integial r > 2, 


( 2 . 1 ) 

For any value of jV let 




= 0 ( 1 ). 


JC — (xi , X2 , • ■ • , ^n) 


be a chance variable whose domain of definition is made up of the W permutations 
of the elements of the sequence An = (ai, a^, • ■ , a^r), (If two of the a,(r = 
1, 2, • ■ ■ , Al) are identical we assume that some distinguishing index is attached 
to each so that they can then be regarded as distinct and so that there still are N\ 
peimutations of the elements Ui, ■ • • , On) Let each permutation of An have 
the same probability (A'!)"'^. Let E(Y) and (t^(F) denote, respectively, the 
expectation and variance of any chance variable Y. 

We now prove the following: 

Theorem Let the sequences An = (ai, a^, • • , Un) and Dn - (di, d^, • • • , dN) 
(N = I, 2, • ' , ad inf.) satisfy the condition W Let the chance variable Ln 
be defined as ~ 

N 

Ln “ di Xt . 

t=l 


Then as N °o, the prohabihly of the inequality 

Ln ~ E(Ln) t cr (Ln) 

for any real t, approaches 



For convenience the proof will be divided into several lemmas. 
Since 


, T * _ — E(Ln) 

^) 

remains invariant if a constant is added to all the elements of Dn or of An, or 
if the elements of either of the latter are multiplied by any constant oihei than 
zero, we may, in the formation of L%, replace An and Dn by the sequences An 
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andDif, respectively, whose ith elements a< and d'i{i = 1, 2, ■ • • , jV) are, reapec- 


tively 



(2.2) 



and 



(2.3) 

d*i = [Mt{Du)]~^ ( 

£ dy) 


The sequences Atf and Du satisfy the condition W. Furthermore, 


(2.4) 


m{Au) SB jKi(I>y) » 0 


and 




(2.5) 


Pi(Au) s MEu) ^ 1. 


Lemma 1. 




(2.6) 

E •• 

/ / / 

* / j ^ 

0(fV'*'’*) 





(2.7) 

z 

• Z dl.dl. ...dl,- 



ai<ai<. 




From (2.4), (2.5), and the fact that the /l(, and D'u satisfy condition TV, it follows 
that the Au and Du satisfy conditions a), b), and c) of the theorem on page 383 
of [1]. Our lemma 1 is the same as lemma 1 of [1]. 

Lemma 2. Let 


F =» (.Vi,Vt, ,vu) 

be the same permutation of the elements of A'u that X is of the elements of Au- Let 
y =svi Via where z = C(*+i) • • < «((+,) ,t/ > 1 (; = 1,2, ■ • •, r), andk,r,ii, , 
i, are fixed values independent of N, 

Then 

(2.8) E{v) = 0(A^“'*'-*), 


This is Lemma 2 of [1]. 

In a similar manner we obtain that 


(2.9) 




■ i: di. 


d',,d 




* 

=» 0 ( Af ■ C >(^■*■'■0 


0(/V‘*'“'’^'')‘ 


The summation in the above formula is to bo taken over all possible sets of + r 
distinct positive integers < N. 

Lemma 3. Let ai, • • ■, «((,+,) be {k + r) distinct positive integers < N. Then 

(2.10) E(ViVi • ■ • V*C(|{+1) ■ ' ■ y(*;+r)) — E(VcnVa2 ' ’ ' ' ' ' ^a'(* + r))‘ 

This follows from the fact that all permutations of j4y have the same probability. 
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Lemma 4. Let 


Ly = d'iVi. 
1-1 


Then 

(2.11) E{Lsn = 0(i\r)iwsi). 

Proof: Expand Ly" and take the expected value of the individual terms. The 
contribution to E{Ls) of all the terms which are multiples of the type appearing 
in the right member of (2.10) with fixed k,r,ii, , Lik + I'l + ■ ■ • + tr = p), 
is, by Lemmas 2 and 3 

••• 2 dl. ••• = 0(iV'*'’’-*)0(iV“'"-^) 


ai.‘V.a(A+r) 

all difierent 


= ©(AT*'*'*'-*-*"). 


Since i, > l(j = 1, • • ■ , r), it follows from the fact that k + ii+ • • • + tV = p 
that 2r < p — k and that 2r = p — k only if ii = • • • == t, = 2. Now 


( 2 . 12 ) 


~k _ 

. 2 . 


k + r <r < < |. 


Hence the maximum value of 2 J — A: + r is reached when r = J and A: =* 0. 
This proves the lemma. 

From the last remarks of the preceding paragraph we obtain 
Lemma 6. 

(2.13) E(L(;0 - ^ (S • • • Z dl*. • • ■ d'l)Eiv\ ■■■<;*)- o(iV0. 

JIZ oi. ,a, 
all alUerent 


We now prove 
Lemma 6. 

(2.14) EiL’i,) = 0 

(2.15) E(L;=) = NE{vl) + o{ir) = N + oiN). 

Equation (2.14) follows from (2 2). Consider the expectations of the various 
terms in the expansion of . The sum of all the terms of the type 

d',d',E{v^,) 


is 

(Ld:d'i)EM = 0{N)0{N-^) = 0(1), 

by Lemmas 1 and 2. The sum of all the terms of the type 

d?E{vl) 
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m 


is 

d!’) i4’(r?) = NK(v!) - A', 

by (2,2) and (2.8). Tlii.s i)rov(>,s (he Ifniina. 

Lkmma 7 

(2.16) A'(i'l • • • t-J) --- 1 I- fj(I) 

(2.17) £ Ed'A •■■rf:*- .VM-oOV'). 

I' 

ftll (iiffcri'nl 


From (2.2) and (2 3), and I,('tntna 3, it fdlhnvs tliaf it wdl Iin .'iiifficicnt to 
prove (2.17), b(’cau.'<(i (2.16) follnw.s in the .■'anit* manner. C'nn.sifler tlm relation 

N’ = (E d?') — E Ed'a I ■ ■ ■ (I'j, 4- other terras. 

Xt*"*! / <*1.* *♦«! 

«I1 


By (2.9) the .sum of tlie.se oilier terni.s inii.st, be not linger than f>(iY'"'‘). From 
this follow.s the leimna. 

PiiOOF of the theoretn: Sinee 

/♦ = ^Ls'-IULk) 

,{L's) ^(A.v) ’ 

it will bo sullicient to .show that the immient.s of A* aiiproiieli tlio.se of the normal 
distribution as N -*► «, From (2.1-1), (2.1,')), and (2.11) we .see that, when p is 
odd, the 7 Jth moment of Av i.s (>{N and lienee uiiproaehes sn'ro a.s N —* «>. 
When p is even and = 2.s (.say), it follows from lyeinnia ,'5 that 


E{L 


/Six _ (2.^)J /y' 

^ s!2' 

all (iifTi'rnit 


£ fC,)E(t't ■ ■ ■ e!) = o(N‘) 


Hence from (2.16) and (2.17) 


(2.18) E(L?‘) = N‘ + o(N‘). 

From (2.18) and (2.15) we olitain that 


lira E(LT) 


(2s) I 
s!2- ' 


This completes the proof of the theorem. 

It will be noticed that nothing in the. foregoing proof nuitiire.s that, when 
JV < N', the sequence.s Au and Dy be Kub.seipicncc.s of A v and Dn' ■ Indeed, 
the sequences were written as lliey were simply for typograjihic brevity. We 
have therefore 
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Corollary 1. The theorem is vahdfor sequences 

= (a^ , • • ■ , Utitf) 

Dtr = (di^i , ■ • ■ , diftf) 

(N = 1, 2, ■ ■ ■ ad inf.) 

■provided they fulfill condition W. 

Corollary 2. If the elements a,{i = 1, 2, • • • ad inf.) are all independent 
observations on the same chance variable, all of whose moments are finite and whose 
variance ^s positive, the sequences Aii(N = 1, 2, ■ • • , ad inf.) will fulfill condition W 
with probability one 

3. The rank correlation coefficient. For this well known statistic (see [3]) 

Atf = D/f = (1, 2, 3, • • • , N). 

The sequences A if and Dif satisfy the condition W. For 

Z / = 0(iV^+') 

1-1 

and hence, for r > 3 

Mr(Ay) = PriDif) = 0{ir). 

Also 

p^iAif) == fiiiDif) = il{N ). 

Hence the distribution of the rank correlation coefficient is asymptotically 
normal in the case of statistical independence. This result was first proved by 
Hotelling and Pabst [3]. 

4. Pitman’s test for dependence between two variates. The distribution 
of the correlation coefficient in the population of permutations of the observations 
was used by Pitman [4] in a test for dependence between two variates which 
“involves no assumptions” about the distributions of these variates. In our 
notation, let 

{a,,d,)(i = 1, 2, ■■■, N) 

be N observations on the pair of variates A and D whose dependence it is desired 
to test. Then the value of the correlation coefficient is 

At the level /3 the observations are considered to be significant if the probability 
that N~^ I I be equal to or greater than the absolute value of the actually 
obseived con elation coefficient is < /3- 
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In his paper ([4), page 227] Pitman points out that if the ratios of certain 
sample cumulants are “not too large,” then, as jV —+ «, the first four moments 
of L'n will approach 0, 1, 0, and 3, respectively (the first moment is always 
zero). Our theorem and the, lelation (2.15) make clear that under proper 
circumstances all the momenta will approach those of the normal distribution. 

6. Pitman’s procedure for testing the hypothesis that two samples are from 
the same population. For testing thi' hypothe.sis that two samples came from 
the same population Pitman [5] proposed the following procedure: 

Let one sample be 

I I * * * > ^fn 

and the other 

1 j f-7 t ‘ I 1 n • 

Write m + n = JV, and construct the acciuenccs /iv and a.s before defined- 
Let 

d,- « 1 (t = 1, • • • , m) 

d( = 0 (i ~ tn + 1, ••• I N) 

and construct the, secjucnccs Dy and .Dy. Then tlie value of tlie statistic con¬ 
sidered by Pitman is, except for a constant factor, 

(6.1) 

At the level the observations are considered significant if the probability that 
I LIv I be equal to or greater than the observed absolute value of the expres¬ 
sion (6.1) is < |S. 

Let N —>■ «>, while - is constant. Then the .sequences Dy are .seen to satisfy 

condition W. If then the sciiuences Ay satisfy condition W wo may, for large N, 
employ the result of our theorem and cxpeditioiusly determine the critical value 
of Pitman’s statistic. 

6. Analysis of variance in randomized blocks. Welch [7] and Pitman [6] 
consider the following problem: Each of n different "varieties of a plant” is 
planted in one of the n cells which constitute a “block.” It is desired to test, 
on the basis of results from m blocks, the null liypolhe.si.s that there is no difference 
among the varieties, In order to eliminate a possible liias cuuaecl by variations 
in fertility among the cells of a block, the vurioties tut* assigned at random to the 
cells of a block. If the cells of the jth block are dc’.'^ignated by (Jl), (J2), ■ ■ ■, 
(Jn), a permutation of the integers 1,2, • • •, n is allocated to the ;th block by a 
chance process, each permutation having the same pruhaliiliLy (n!)''\ 

Let Xi /i, bo the yield of the fth variety in the itth cell of the jth block to which 
it was assigned by the randomization process. It is a.ssuined that 

= l/jk + 5^ + e,k , 
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where y,k is the “effect” of the feth cell in the ith block, 5; is the “effect” of the ith 
variety, and tjk are chance variables about whose distribution we assume nothing. 
The null hypothesis states that 

^ • = Sn = 0. 

Let a,k be the yield in the Aith cell of the jth block and the yield of the ith 
variety in the jth block. If the null hypothesis is true then, because of the 
randomization within each block described above, the conditional probability 
that, given the set {a,fcj (fc = 1, 2, • • • , n), the sequence • • •, Xn,, be any 

given permutation of the elements of [a,k} is Permuting in all the 

blocks simultaneously we have that, under the null hypothesis, given the set of 
mn values (j — 1, 2, • • ■ m; fc = 1, 2, • • •, n), the conditional probability 
of any of the permutations is the same, {«.!)“”. This permits an exact test of 
the null hypothesis. 

The classical analysis of variance statistic that would be employed in the 
conventional two-way classification with independent normally distributed 
observations is 

p ^ (m - Dot X) - xf 

Z) Z - X,. - X j + x)^ 

where 

X{ — Xij 

’ * = (mn)"‘ Z Z • 

x.j ^ n 2-j X(j 

The statistic W used by Welch and Pitman is 

W = Fim - 1 + F)~\ 

Since W is a monotonic function of F and the critical regions are the upper tails, 
the two tests are equivalent. The distribution of ff' or IT is to be determined in 
the same manner as that of the other statistics discussed in this paper, i.e., over 
the equally probable permutations of the values actually observed. The critical 
region is, as usual, the upper tail. 

Since Xi, takes any of the values a,i, • • •, o,„ with probability 1/rr, we have 

(6.1) = n~'- = ay (say)- 

h 

(6.2) aixij) = n~^ Z (ay* - ay)’ = by (say). 

k 

<r(®<iy;c,jy) = [n(n — 1)]~’ Z Oy*!®;*. — a? 

= [ra(n - 1)]"M(Z ay*)’ - Z a’*] - a] 

h k 

= [n^a] — Z «»*] — 1)]~‘ “ a? 

k 

= (n - l)-‘[a? - Z a%] = -(n - l)-‘b/. 

k 


(6.3) 
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Hence 

(6.4; 

( 6 . 6 ) 

(6.6) 

Let 


Eixt.) = ?n“‘ “/ • 

(r’(a:<.) = m“* J^bj b (say). 

cr(x,i. ij,.) = -(m*(n - I)]'* J^bs ~ c 

ii 


Xij 


i! — 22 


(t, t» ~ 1, • ■ ■ , n) 


wliere || Xi, || is an orthogonal matrix and 

Xnl “ Xnt Xnn- * n 


Then it follows that 

E(xt) = 0 

(6.7) <^’( 1 *) = 6 — c (i = 1, 2, . • • , n — 1) 

(r(x*pX*,,) = 0 {ii 7 ^ k = 1, • • • , ?i - 1). 

Furthermore, we have 

(6.8) 2 “ 22 ~ 2:)*. 


Applying the well known identity 

SS(x</ — X,. — x.f + 2:)* = £ 2 )(x(,' — X.,)’ ~ mX(x,. — x)* 
to the definitions of F and W we obtain 


(6.9) 


m 


TF = 


22 (*<■ - s)* 


22 22 (xw - 

i / 


The denominator of the riglit member of (6.9) is invariant under permutations 
mihin each block and equals 

22 22 (ay* - a,-)’ = (n - l)m*(6 - c). 
i * 


IF » [m(ri - 1)(6 - c)]"' D (x.. ~ xf 

imI 

= [7n(n — 1)(6 — c)]"^ 2 xf.“. 

.-1 

If the joint distribution of the x*(i = 1, 2, • • • , 7i — 1) over the set of admissible 
permutations approaches a normal disti’ibution with non-singular correlation 


Hence 

( 6 . 10 ) 
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matrix as m, the number of blocks, becomes large, it follows from (6 7) and (6.10) 
that the distribution of m (n — 1) W approaches the distribution with 7 i — 1 
degrees of freedom. Hence it remains to indicate conditions on the set {a;*,} 
which would make the di.stribution of thea:r approach normality. Each a:r. is 
the mean of independent variables, so these conditions need not be very 
restrictive. 

According to Cramdr [8], Theorem 21a, page 113, if the variances and co- 
variances fulfill ceitam requirements (the limiting correlation matrix should also 
be non-singular) and if a generalized Lindcberg condition holds, normality in the 
limit will follow. Somewhat more restrictive conditions which are simpler to 
state and which will be satisfied in most statistical applications are that o < c' < 
b, < c" for all j, where c' and c" are positive constants. Since the variance of 
z,, is (n — 1) ^nhj , it can be seen that the above inequalities imply the fulfillment 
of the conditions of the Laplace-Liapounoff theorem (see, for example, Uspensky 
[9], page 318). By [G.7] the correlation matrix is non-Singular* 

7. Hotelling’s generalized T for permutation of the observations. In this 
section we shall restrict ourselves to bivariate populations, the extension to more 
than two variables being straightforward Let (un , Uji), • ■ , (ui„, iitm) be m 
paiiK of observations on the chance variables Ui, (/j, and (iiKm+n , uicm+n), • ■ •, 
(ui:f, uw), be n pairs of obseivations on the chance variables Ui, U't, where 
m + n = N. If each of the pairs I7i, U<i, and Ui, Ut is jointly normally 
distributed with the same convaiiance matrix, the Hotelling generalized T for 
testing the null hypothesis that 

(7.1) E(Ui) = E{U[) 
and 

(7.2) fi(U.) = E{V'^), 
is given (Hotelling [10]) by 

2 Z) ff.yCwt —— u,) 

i-i —i 

where 

ffl y 

mu, — Z = Z w.i 
1—1 

and the matrix || q,j || is the inverse of the matrix || || with b„ given by 

(N - 2)bij = Z (w.i - M.-)(«yi - •fij) + Z («<i - - u,). 

Imal 1 —m+1 

In Hotelling's procedure the b„ are sample estimates of the population co- 
variances whose distribution is independent of that of the sample means A 
constant multiple of the statistic has the analysis of variance distribution 
under the null hypothesis If the population covariances were known and used 
in place of the b„ , would have the x* distribution with two degrees of freedom. 
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teb U8 now apply the genemliK'd 2’ over the pernnitations of the actually 
obaervcd values, na wan done with other atatiatlea in previoua wctiona. If we 
do this literally we will find that the h,-, are no longer indeiiondent of the sample 
means. To avoid this complication we. shall use a sliglitly different statistic T' 
which, as will be shown later, is a monotonic function of T, so that tlie test based 
on T' i.s identical with that baaed on T. The statistic T' is defined as follows: 
Ivet 

D, « N-^i.ua 




t 


m{N - Dmnl"' £ (tti* - ! 7 .)(ua - 17 ,) (x,;, » 1 , 2 ) 


and 

Then 

(7.3) 


\^ti\ 


c;n 


r'* - i: z ~ dj). 


The expression T'’ is much simpler than T\ since the coeflicients q// are 
constants in the. population of permutations of the observations. We shall 
show that T'* is a monotonic function of T’. Li't 


£ (ua “ d<)(uy* — il/) + £ (uu — dv)(M/* 








Q'u “ £ (lii* — J7,)(w,* - 77/) 


n'f/t 


wQuir 

iiQoir. 


Then the expressions 

(7.4) 

and 

(7.6) 


rJ = £ £ Q^\ui - ii;)(ti/ - <i'>) 

1-1 ,-l 


1-1 /-I 


are constant multiples of T* and T'*, respectively. lienee it is sufficient to show 
that TI is a monotonic function of Tl. Wc have 

(7.0) Qij = Qu + 7niili - U(K^j ~ Vi) + n(«: - - 77/). 

Furthermore, we have 

mUi + niZ; _ nifii — xi ;) 
ffi + n m + Tl ' 


(7.7) 


Ui - 


tZi — 
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Similarly 

(7.8) 


u[ — Ut = u[ 

m + n 

From (7.6), (7.7) and (7,8) it follows that 


_ muj + nu[ _ m{u'i — ui) 


m n 


(7.9) 


Qvl — Qij + 




mn 


{m + n)® 
mn 


(u. — u[){uj — u') + 


nm 


(m + n)“ 


(Uf — Ui)(Uj - u,) 


m + n 


(i2, — u,){uj — u,). 


Denote-;— by X and u, — u, by hi. Then we have 

(7.10) Q\, = Q., + . 

Denote the cofactor of Qj, in |1 Qi, |1 by B,, and the cofactoi of Q[, in || Qij 1| by 
Bi, . Then 

(7 I Qu I _ I Qij I __ I Q«j I __ 1 

I IQ., + Xli.ii,! 1Q„| + XSSB.,;i.X, 1 + XT?' 

Furthermore, w'e have 

/n los I Q*) f _ I Q<i hhihj I _ I Qi, I \'EiSiRi,h,hj , 

iWi- —f^i -loti-‘ 

From (7.11) and (7.12) it follows that T* is a monotonic function of Tf . Hence 
also is a monotonic function of T‘ and, therefore, we do not change our test 
procedure by using T'^ instead of T*. 

Let the sequence of pairs 

(tii . a:2i), • • • , (xiff I ^k) 
be a permutation of the actually observed pairs 

(till , U21), • • • , (UlN , ihn) 

where to each permutation is ascribed the same probability Then one 

obtains for i = 1,2, 

(7.13) - i() = 0 

(7.14) o-®(5< — ^0 = N[(N — l)mn]~*2^ {uij — = c'n 

(7.15) jB(xi — x()(x2 — i'i) = N[(.N — l)mn]~^ 23 (mu ~ E^i)('Wjy — U 2 ) = Cia. 

Hence 11 c[, 11 is the covariance matrix of the variates 

(xi — x[) and (S3 — xj). 
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?T()w we nhovv that the Innitinp; distrilnition nf 7’'*, as A’ -> cjo, is the x’ 
distrihution with 2 d(‘p:rf'f's nf freedfpiii, pnividecl that tia* olpservation 
(i = 1, 2; fc “ A^) satNfv some shjaihf restnetimis. Since || q',, || is the 

invt'nse of the covariaiiee matrix jj r,, Jj our .statement ahoiit the limitiup; di.stri- 
hiition of 7"^ i.s olivimisly ])rov(‘d if we can .show that li — f' and .ij — i-j imve 
a joint normal dlstrilmtinn in the limit. 

Let A’*oc while m/n remains constant. Tjct the .seciumice.s J/, and of 
Section TI he defined as follow.s: 

There are two seiinences A,v , denoted re.siieetively hy /Ij.v and Aa.v , ,sueh that 

a - 1. 2;j 1, ... , A^). 


(j ^ I, ■■■ , m) 

(j ^ m + I, ‘ , N). 


Also 


a,j =^- H., 


d. = 


m 


cl, 


Tlien the scmucnccs D,,- .satisfy the cundition IT. If also the .se(int'n(i(‘.s 
satisfy the condition If, the dislrihulioii of — s[ ajijiioaelies the normal 
distrilnition a.s N inerease.s, by tlie Iheouiin of Section 2. If the joint, distribu¬ 
tion of .?i ~ X,' and ;t'2 - .?2 uiiproaclies a, noimal di'^trilnifimi with iioii-sinKiilar 
correlation matrix, the distriliutioa of T'‘ ujiiiroaehes that of x’^ with two degrees 
of freedom. 

The correlation matrix of (.I'l — .Pi) and (.ih -- jfa) ivill he of rank two in the 
limit if the correlation ciK'dieumt between {.Pi -- ii) and (jj — .Pj) approaches a 
limit p, where | p [ < 1. Bj' (7,14) and (7,b'j) this is e(piival(‘nt to saying that 
the absolute value of the angle between the vectors A[.v and Aav w eventually 
greater than a positive lower liouml. \Vc .shall .show tliat, if the correlation 
coefficient apjiroachos, a.s A'’ —> «>, a limit p whoso al i.solute value is k'ss than one, 
and if Ais and A^n sati.sfy the condition H’', then (.Pi — ;rl) and (.Pi — fi) are 
jointly normally distributed in the limit. 

Let fii and 62 be any two real numbers not lioth zero. Then the sequenee 

ylj? = (fti , ■ • ' , (In) 

where 

a* = «i«i, d- 62«2; 


will be shown to satisfy the condition If. If eithi'r 5i or Si i.s zero this is trivial; 
nasume therefore that neither is zi'ro. Without loss of generality we may assume 

N 


that £ " d) for if this were not so W{> eould rejdaco the oiiginal a,,- by a't, = 

j-i 

an — N~'' a<i as was done in Hoclion 2. Let p' lie such that 1 > p' > | p |. 
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For N sufficiently large we have 

MaWw) > N~^{8l X) O'li — 2 1 SjSj 52 aiithi | + sl X 
1 1 

> N'\sl X - 2p' I SiSj I V(Xa?,)(X 4) + 5^ E 

j 111 

= N-^[i\ Si IVE^ - 1521 VTM, y 

} j 

+ 2(1 — pO 1 Si 52 ] ^(E aij)(E 0 .%)] 

7 1 


and 

M2(d.v) < 2(5lP2(A.lw) + 52M2(A2 jv)). 

Hence 


(7 16) 

= n[max (p 2 (Aiw), ^ 2(^.2^)}] 


Also Mr(Aiir) is a sum of constant multiples of terms of the type 

A~' E alaiy 

7 

By Schwarz’ inequality 

(7.17) N-^ E a{,air < ^-'(E alOKZ = (p2.(Aii.)M2a-o(A2y))‘. 

3 3 3 

The required result follows from (7.16) and (7.17). 

Since the sequences A^ satisfy the condition W, the limiting distribution of 

5i(ti - .-ti) + Biixi - $. 2 ), 

for any pair 61, S^not both zero, is normal. Prom this and a theorem of Cram6r 
and Wold ([11] Theorem 1, see also [8], Theorem 31) it follows that if the joint 
distribution of (.ti — xi) and (:r2 — X 2 ) approaches a limit, this limit must be the 
normal distribution. From a theorem of Radon ([12], see also Cramdr [8], page 
101) it follows that if the joint distribution of (xi — x'l) and (£2 — rs) does not ap¬ 
proach a limit as Af —^ 00 it IS possible to find two subsequences of the sequence 
(1, 2, • ) Af, • ad inf.) for each of which the joint distribution appicaches a 

different limit. This contradicts the previous result. Hence the limit exists 
and is the normal distribution. This proves our statement that the limiting 
distribution of T'~ is the distribution with two degiees of freedom. 

The statistic T'^ seems to be appropriate for testing the null hypothesis that 
two bivariate distributions IIi and 112 are identical if the alternatives are re¬ 
stricted to the case where TIi differs from lit only in the mean values, 1 e , the 
distribution Ha can be obtained from Hi by a translation This is no rcstiiction 
as compared with Hotelling’s T-test since also the T-test is ba.scd on the assump¬ 
tion that the two normal populations differ at most in then mean values, i.e., 
the covaiiance matrices in the two populations are assumed to be equal. 
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ERROR CONTROL IN MATRIX CALCULATION 

F. E. SaTTEETHWAITE 
Aetna Life Insurance Company 

1. Introduction. The solutions of large sets of simultaneous equations and the 
inversion of matrices are often complicated by the fact that errors, such as those 
introduced by rounding, become magnified in the course of the calculations to 
such an extent that the results are useless. In this paper we shall show that if 
the norm of the matrix .4 — J is less than 0.35, operations involving the inversion 
A or the multiplication by 4"^ will be in a state of error control for “Doohttle” 
methods of calculation Thus such calculations may be carried through with 
assurance that the errors in the results will be limited to two or three significant 
figures. We also point out that as soon as an approximation to A"' is available, 
most problems may be restated to bring them within the requirements for error 
control. Therefore the solution can be immediately completed to the desired 
degree of accuracy in one step instead of requiring multiple steps as do the 
iterative methods. 

2. The inversion of special matrices. Consider the problem of inverting the 
matrix {I + F) where I is the identity matrix and (/ + F) is a non-singular souare 
matrix. Let 

( 2 . 1 ) G= {I + F)~\ 

Then 

(2.2) (/ + F)G = I 
or 

(2.3) G = I - FG, 

In ordinary algebra this would not be a practical formula for the calculation of 0. 
However in matrix algebra the situation may be different. Examine the ex¬ 
panded form of G: 

(2.4) ffij — 

The summation is over all values of k from 1 to n. Next examine the affect of 
imposing certain restrictions on F. For example, let fi, — 0 if j > i. This is 
equivalent to making the summation in (2.4) over the range 1 to ^ — 1. The 
first row of (2.4) then becomes 

and no g’a appear on the right. For the second row 

Qi] = Sj) — faQu • 

373 
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The only f/’s tm Uu' usUt luc tlinsc nn tlic iii>t row wliich have already been 
calculutcMi. For the third row 

ttaj - Ssj —' Jatili! Sa2(li, . 

The only '/V on tlic iij!;hl iuo in the lirst and M‘t’ond rows and hiiv(‘ already been 
ealcnlalI'd. SiniilaiK for the fomlli and later lows, 

Tims i( i.s .M-eii that if F is a “i»re-dia>!;onal” inatriv, (2,31 is a very ,sinii)le and 
practifal fonunla for the mnueiieul ealenlaliou of (he invewse of f/ + F). Also 
if F is a iio,st-diagonal ina(ri\, (2,3) may be nsetl by working: up from the bottom 
row. 

v'siinilarly, if a miUrix 11 is to be nniKiplied by (lie iiuei'.s(“ of (/ {■ /*’), lot 

(2.51 G - (7 + Fy 7/ 

and the w orkiiiR equation lu'oomes 

(2,(1) G = 77 - FG. 

Tilt” iuvi'r.sion of a diagonal niatiix i« aoooinphshed by invortiriR ouch of its 
diatronul elements. I'liat is if 

(2.7) F II 11 
them 

(2.8) F ' - II ' ||. 

3, The inversion of general matrices. 'J'hi' gmieial inver.sion jirolilem will bo 
solved if a geiKU'al inalrix otiii be faotoied into matrioes of tlu' .spi'cial typos 
tieated in the last .section. For tlu' moment n.'-sume that .such a factorization is 
pos.sible and let the factor.s of the general matrix, vl, be 

(3.1) A = ilii + 7).Si(7 -b TO 

where, Ri is a prcdiagonal matrix, Si a diagonal matrix, and '7*1 a po.stdiagnnal 
matrix. Then 

(3.2) A = ,Si + HiSi + SiTi + RiSj\ . 

A sliglit change in form now appi'iu.s desirahle so let 

(3.3) A (RS ‘ -f- I)S(.I + S ‘7') 

- 7i! H- .S' -I- T + US 'SS 'r 

- li + S + T -f RS 'r. 


(3.4) 

For convenience let 

(3.5) 


IJ =- U + S + T 
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and remember that R, S, and T have no non-zero elements in common. There¬ 
fore the non-zero elements of R, S, and T are equal to the corresponding elements 
of B. Rearranging (3.4) gives 

(3.6) B = A - RS~^T 

and the elements of B are determined by 

(3 7) = a., - S . 

su 

Since r.A = 0 for k > i, there is no point in making the summation beyond 
k = ^ — 1. Also since ii; = 0 for k > j, there is no point in making the summa¬ 
tion beyond j — 1. Therefore the summation in (3 7) is to be considered to be 
over the range 1 to the smaller of i — 1 and j — 1 The r’s, s’a and t’s on the 
right of (3 7) can now be replaced by the corresponding h’s : 

(3 8) = 

Since the first row (column) of b’s equal the first row (column) of a’s, the second 
row (column) of b’s is a function of only those h’s in the first row and the first 
column, etc., any calculation routine which works down fiom the top and from 
the left to the right will lead to a ready determination of all the b’s by (3.8) 

Thus we see that the assumed factorization (3 3) of A is always possible (unless 
some of the diagonal elements, , of B are zero) and moreover the elements of 
the factors are readily calculated by the simple equations, (3.8) 

Therefore, to invert the general non-singular squaie matrix A, calculate the 
elements of an intermediate matrix B = R-\-SA-Thy equations (3.5) and (3 7). 
Then from (3 3) we have 

(3 9) = (/ + S-\I + RS-y^ 

which can be readily calculated by the methods of (2 3) and (2 6). 

4. The Doolittle method- The Doolittle method of matrix calculation can 
noAV be expressed in terms of the matrices R, S, and T studied above. To 
illustrate we shall use the set of equations- 

(4.1) diiXi -|- 01212 "h 0,13^3 — CnVi "h CiiUi 4" CisJ/a = di , 

CLilXl -f- diiXi 4- 033^3 — CilUl 4~ 022^2 4~ CisUZ = ^2 , 

4- 032312 4~ 0333^3 = CiiUl 4" C 522/2 4" CniJ/s = ^3 . 


This set of equations will be represented m the form of a three element matrix, 
(4.1.a) \\AX.CY.D\\. 
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The essential feature of the Doolittle method of solution is that we replace (4.1) 
by an equivalent set of equations for whicdi tin; prediaRonal coefficients of the 
X'b are all zero and tho diagonal coefficients arc all unity. Therefore confsider 
the, set formed as follow.s; 

(4.2) II A,X : C,Y : /), 1| = &^-*{|| : <71'; /) || - R || A,Y : C,F ; A ||). 

Then 

(4.3) Ai = X 'M - /M.l 
or 

(4.4) iS + R)A, = A 
or 

(4.5) = (5 + Rr\RS-^ + DSil + S-^T) by (3,3) 

= (J + S-^T). 

Since S~^T is a postdiagonal matrix, || AiX : CjF : Ih || are. the required inter¬ 
mediate equations for a Doolittle type of solution. 

The final solution is now easily obtained. Consider 

(4.6) 11 ^X : CiY : Di II = I1 yl,X : (UY : A || ~ |1 ^,X : C,Y : A ||. 

We have 

(4.7) A.’^Ai- {S-'T)Ai 
or 

(4.8) (/ + S"'T)Ai « Ai 

= / + T‘!r by (4.5). 

therefore At is in fact the identity matrix and (4.6) can be rewritten 

(4.9) II X : C,Y : A || - || A,X : AF : A 1| - ‘F) || X : AF : A || 

5. The non-symmetric case. In actual practice, the work has to be so 
arranged that the elements of the matrices R, S, and {S~^T) are set out so as to 
be readily available for use as multipliers in forming the intermediate and final 
sets of equations. Table I gives such a practical layout for the non-.symrnctric 
case. 

Tho elements of are set out as the po.stdiagonal elements of Ai so that 

they do not need further attention. To determine tho elements of R and S, 
we form a set of pre-intermediate equations; 

(6.1) IIBX II = mx II ~ J? |M,X - X :•••:••• ||. 




table I 

Layout of DoohUle solulton for the non-symmetric case Coefficients not used further are indicated by ■ 

anXi + OniTj + a^Xi = Cnyi + Cnyi + Cuy, = di 

aiiXi + ariZi + chiXi = Caj/] + cuyt + Cuyi = dt 

anXi + 03212 + 03323 = CsiS'i + Ciy, + cuyt = di 
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Z7H 
Th(‘ii 

1! - A - RIU ~ I] 

- .1 - im H- ,S' 'T) - /) l,y (4,5), 

-■ /I ~ hS 'T 

(5 2) - H -I T. hy iH.f)) and (3.0). 

Tlic'i(‘l’ni'«‘ uc .sec Hull till' iin'diap;t»rial ('iK-IHi'icnls nl' llic* .ra in (5.1) ara the 
clciui'iiK Ilf k and llial the dia>t<mal (■uaHu'iinif.s arn (lin nlnnient^ nf iS'. The rest 
of Ihc eoetiiciiads 111 llii" M'l of ciiiiafioiis are iiiil needed in tlie ealeiilalioas and 
liavelieeii iiidieated hy diit> in Tallin I. 

6. The symmetric case. If the A matrix a .synimetiie, advantage can be 
taken of the fact that tlie li nialrix i.s also syininidrie Tlieiefore 

(0.1) .S + 7’- .S’H"/f' 

and the cletuenls of H and k' can he wrillen down ju.st liefore the iliviwion by su 
in tlie calcnlalion of the Aa inalrix: 

(0.2) A, = (/ -I- *S' 'T) - .S' ‘(iV d- T) by (4,5) 

- .S' H- k') 

The layout of the work is given in 'I'ahle II. 

If the C'i inaLri.x is .syninuAiic, the iirediagonal el(!inent.H of (\ can be entered 
hy symmetry. Therefore, it is not only nnnnc(!S.>'iiry to calculate the iircdiagonal 
eleinenls of Ci, hut we can also omit the prediagonnl eleineiit.s of C'a. Note 
that in thus ciusc (\ must lie calculated from the right to the left as well a.s from 
the hottom up. 

'riie niiust important ease wlu'i'e it is known in advanec that (\ us symmetric is 
Ihe determination of the, inver.sc of a symmetrie matrix. Then ~ I and 
.1 \ Also till! postdiagoiial elements of f'j are all zero bo tliat the only 
element.s of f-'a wliich have to he ealeulated arc Hie diagonal elemenhs. These 
are Hie reciprocals of the .s,,’s 

A ease where (\ us symmetric Hiougli (' ?^ I will appear in a subsequent paper. 

7. Norms. Tn order to slate tlie eonditions for error control in a matrix 
ealeiilation, a concept of Hie norm or the ahsolule value of a matrix Is necessary. 
Ill 11lls piqier the nonn will he delined as the .square root of the sum of the .squares 
of Hie eleiiieiiLs of Hu* malri.x. That i.s 

(7.1) A'(/'’) - v'i.£,(A)-. 

'Die two lia.sic ineiiualilies salislied by the norm urn 

(7.2) Nik + G) < Nik) + N(G) 
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(7.3) NiFG) < NiF)NiG). 

All other piopcrties of the norm are derived from these. 

For future refeienec we list the following norm relations: 

(7.4) N[iF){I + G)] = N{F + FG) 

< N{F) + N(F)N(G) 

< NiF)[l + Ar(G)] 

If N (F) < 1 we have 

(7.5) mil + Fm - I] = N[I - F + F'^ - - I] 

< N(F) + [Ar(F)]^ + [N(F)? + 

NjF) 

- 1 - NiF)' 

If MiG - J) < 1, (7.5) becomes 

(7.6) 1 + N(0-‘ - I) < —) 

When MiF - I) < 1 

(7.7) NiF-^ 0 ) < mi + (F~' - mo] 

< [1 + NiF~^ - I)] NiG) 

NjG) 

- 1 - NiF - I) 


by (.7.6) 


8. Error matrix and error norm. We shall also need a formal statement as to 
M'hat we mean by error and we need a measure of the errors. 

By an error matrix we mean the matrix whose elements consrst of the differ¬ 
ences between the value of the matrix elements as actually calculated and the 
tiue value of the matrix elements which would have been obtained if all calcula¬ 
tions had been made exactly without any rounding or other approximations. 
The fundamental relation for the error matrix, E[JiG)], of a function, /(G), of G 
is 

(8.1) EUm = /[G + EiG)] - /(G). 

If each element of a matrix is calculated to q decimal places and the matrix 
has p rows and p columns, the maximum rounding eiror introduced in any 
element is 5 X 10“^ The norm of the erioi introduced by rounding is less than 


( 8 . 2 ) 


NEi = VpM-S X lO-ap 
= .5 X 10"’ X p. 
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For triangular matrices 

(8.3) NEi - .6 X 10 'Vp(p + l)/2. 

For one column matrices 

(8.4) MEi = .5 X UrVp. 

For future reference the following formulas for error norms are listed: 


(8.5) NEiF + G) < NE(F) + NE(G). 

(8.6) NE{FG) < NE{F)NIG + AX^^')! + NE{G)N(F) 

< NE(F)N(G) + NEiG)N{F) + NE(F)NE{G). 


(8.7) NE[F{J + G)] ^ NEiF)[l + E[G + E(G)] + NE{G)N(F) 

< NE{F) + NE(F)NiG) + NBiG)NiF) 

+ NE{F)NE{0), 

UN{F ~I) + NE{F) < 1, 

(8.8) NEiF~^) = NE[I + (F - 7)]“* 

__^ 

+ tF + W) - 1] I + (E - i)J 

« A^(/ + [F+ E(F) - + (F~ I)]~'IE(F)I 


_NE(F) 

^ ii~mF + TO'-'/jiir- iv-(>'-'/)) 

^ //E(F) 

~ [1 - E(F -7)~~ NE{Fj] [1 '-'N(F - J)]' 

IfiV(F - I) + NEiF) < 1, 

(8.9) NEiF~"^'' - G + EiO) G 


by (7.7), 


■‘G) 


+ [F + EiF) ~ I] I + iF ~ DJ 
_ ^ r [Em [I+iF~ Z)] - [F(F)] [0] 1 
Ur+W + W‘-'Z]| (7 + If - Z)1 J 

^ NEiG) + {127F(F)]/11 - N{F - Z)]) [Z^(G)) 
^ ' 1 - A^tF + E(F) - Z] 


by (7.7). 


9. Certain maxima. The R, S, and T matrices have no non-zoro eloments 
in common eo that 

(9.1) NiB ~ I) ^ NiR + S ~ I + T) 

= ■v/W(Z5'F+ (i7TF^Zyr+l“iV(T)]“. 

Similarly 

(9.2) NEiB) = V[iv7;(z5]®TWMs)F+lA^FTT)?. 
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The developments of the following formulas for certain maxima are not given 
here since they involve only well known calculus principles. It is understood 
that these inequalities hold whenever the quantities involved exist. Usually the 
maxima are given subject to the condition NiT) = N{R) as well as for the 
unrestricted case where N(,T) may be zero. 


(9.3) 

(9.4) max 

(9.5) 


N{R)N{T) , 

1 — N{S — I) ^ 

N{R) NiB - I) 


1 - - 7) (1 - [NiB - 7)]2!i« 

NjB - I) 


V^Vl- [NiB - I)f 


- 7)P. 

if NiT) = 0, 
if NiT) = NiR). 


(9.6) max [NiR)NEiT) + NiT)NEiR)] = V[NiB - 7)]* - [NiS - 7)p 
Any substitution satisfying the relation 


X V[NEiB)]^ - [A^.B(<S)]». 


(9.7) 


NBiR) N(T) 


NBiT) N(R) 
will cause (9.6) to attain its maximum. 

(9.8) max[iV7;(K) + kNBiS)] = VV+k^ NBiB) if NBiR) = NBiT), 

(9.8.a) = \/l + k^NEiB) if NBiT) = 0. 

k + NiR) , [NiB-I)? 

(9-9) 1 _ ]\r(5 _ j) ^ + K 


where K is the root of 

(9.10) [1 + k^]K^ + 2[k[NiB - l)f]K + {[NiB - 7)]* - [NiB - 7)]=} = 0. 


10. Errors in the Doolittle method. In all that follows, we shall assume that 
AT (A — 7) is small enough so that the “divisions” are permissible. First let us 
examine in the multipliers B = R + S T. By (3.6) 

(10.1) B - I = iA-I) - RSr^T. 


Therefore 


NiB - 7) < NiA - I)+ 


NiR)NiT) 
1- NiS - 1) 


by (7.3) and (7.7), 


< iV(A - 7) + 1 - Vl - WiB - I)Y by (9.3) 


( 10 . 2 ) 



382 


F. h sAt ri'.unnvAU K 


Ilf*mfmhc>ririg that /I has ikj (‘rmr ami Icftinp: XK, tia the rdiimlhip; oiTor norm 
intrcKhiood in writiiift down tlic clcimaifs, wo have 


(10.3) NE{H) < NEi + 

+ 


XKiR}X(T) - NJCmNUn + NK(R)XE{T) 

by (8.0) and (8.G). 


1 - .Y(.S'd- AX'S’) “ /] 
NK{S\N(T)XiR) 

1 ™ .VIA + A(A) - I]\\\ - .V(A «-■ /)} 


We are inlorcatod only in the rango of value.*' when* the error.s ai'o .small. There 
fore wo .“shall ignore Koooml order error.*'. Mvoept for .‘'iioh errors, 


(10.4) NE{li) < X}‘\ + 


1 


A'('/‘) 
AXA - 


/) 


XliiR) 


iV(A) 

- A'(>S' ■ 


1} 


NE{T) 


+ 


N{T)N{K) 

[1 -N{R~m 


NE{S). 


The hwt term wdl be large.st when X(T) - A'(A’). Then'fore tlu; .sum of the 
seotmd and third will be large,st when XK(R) ~~ XR(T} by (0.7), 


(10.5) Nim < NEi + 2 


NiR) 

1 - N(ti - I) 


NE(R) + 


N{R) 

.1 - X{E - I). 


NE(8). 


By (0,8) we now obtain 


( 10 . 0 ) 


where 


WA(A) < NEi + AV2 + A- KE{li) 

XEi 

- 1 " Av'2 + A» 


A max '^ _ __ by (9.5). 


Actually in practice, W'e introduce the. rounding error in (»S' '?') insU'ad of in T 
as assumed above. Our as.sumption i.s eon.ser\'atlve, since, the division by S 
magnific.s any error m T. 

Next considei the errors in the Cj (or Da) nuitiix. From (4.2) 


(10.7) C, = A \C - RCi) 

= - .S' 'RCi 

« {I + A ’A)' 'A Y; by (2,5) and (2.6), 
=■■ [A(/ + A" ‘A)J Y; 

= (A -f ur'e. 


( 10 . 8 ) 
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N{C) 


1 - N(R + S - I) 


by (7.7), 


NiO 


Therefore 

(10,9) NiCi) < 

- 1 - N(R) - N(S - I) ■ 

From (10,7), remembering that C has no en-or, and letting the rounding error be 
NE>, 

(10 11) NEiCa) < NEa + + NE{C3)N[R + E{R)] 


+ 


1 - iV[,S + E{S) - 7] 
NE(S)mC) + N(R)N(Ca)] 


1 - N[S + EiS) ~ 7]H1 - NiS - 7)1 
NE{R) + NEiS) 


by (7 7) and (7.3), 


< 1 - N{R) - N{S - 7) 


N(C) + [NEa] 11 - N[S + E(S) - 7)} 


1 - jV[7i: + E(R)] - N[S + E{S) - 7] 


smee 


(10 12 ) 


NiC) + N(R)N{Ca) 

1 - NiS - 1) 

- 1 - iV(S - 7) L 1 - 
< 


NiR) 


N{R) - NiS - I). 
NiC)ll - N'iS - 1)] 


by (10,10), 


[1 - NiS - 7)] [1 - NiR) - NiS - 7)] 

and since transferring the terms in NEiCa) to the left requires that we divide 
through by 

. N[R + EiR)] 1 - NIR + EiR)] - N[S + EiS) - I] 

(lU id; 1 ^ ^ jj 1 _ _ j] 

Again we can ignore second order errors. Taking maxima by (9 8 a) gives 

V2 NEiB)NiC) 

(10.14) NEiCa) < ^ 


1 - V2 NiB - I) 


NEa 


1 - V2 NiB - n 


and 

NEiCa) . V2 NEjB) , [J\7F3l/[Ar(01 

(10.15; - [1 _ ^2 NiB - 7)f 1 - V2 fV(B - 7) ■ 

Thus we see that the piopoitionate error m Ca is made up of two parts: the first 
due to the rounding errors in the multipliers as given by the first term and the 
second due to the proportionate rounding error introduced in calculating Ca. 
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Finally we havp the errors in the Ct (or Di) mafrix. Since 

(10.16) Ct = A~'C 
we have 

(10.17) 

By (4.6) 

(10.18) C4 « C, - (S-*3’)C4. 

If we let NEi be the roundinR error introrlucod in this step 

NB(T)NiCi) + NK(Ct)N[T + AXT)] 
^r- iV[s +~F(S) - 1 ] . 

iVA’(.S’)iV(ir).V(6'4) 


(10.19) NBiCt) < NE{Ct) + NEt + 

+ 


!!• 

{NEiC,) + NE 4 ] |1 


iV[S + EiS) - I\\ [I ~ N{.S - I)\ 
ms + E{S) ~ /]} 


NB 


+ NB{T) + 


mT)NE(S) 

1 ~ N{S ~ /)J 


EiO 

,1 - N{A "■ 


I). 


1 - N[T + E{T}] ~ E{S + E{S) - I] 


by (10.17) and relations similar to (10,13), We. now iKunre sceonrl order errors 
and take maxima by (9.4) and (O.S.a): 

NE{C,) (NEi) ,Vl+ NE{B) 

fin 20 ^ 1 ^ ^ 

( 10 . 20 ) ■ _ 


1 - V2 N(B - I) 

_i 4 ... . V2 

[l-i\f(A-/)]V'l-lAf(B-7)]» [1-V2 

, lWi3]/I/^(C)] 

+ ■ ■ 


NE{B) 


< 


, ^ 

1 - \/2 N{B - 7) ^ N{(J) 


where 

( 10 . 21 ) 

and 

( 10 . 22 ) 


K 


max 


N{T) 


1 ~ V2 N{B - 7) 


1 - Af(iS - 7) 


N{B ~l) 

Vl - 


by (9.4), 


Vl+'m = l/Vi - liV(B"- 7)?. 


If .4 is symmetric, NE{B — 7) remains unchanged but NE{Ci) can be some¬ 
what strengthened through the use of (9.6) and (9.8) instead of (9,4) and (9.8.a), 
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The result is 


nn <r r_1_ 

'' N{C) L[1 ~ NiA - I)W2Vl - [N{B - 7)p 

+ V 372 lr NE{B) ~| 

(1 - Vm NiB - /)]“JLl - V3/2 N{B - /)J 

_1 _ NE, 

[1 - ■v/ 3/2 NiB - I)Y N{C) 

_^ 

^ 1 - V 372 NiB - I) NiC) ■ 

If C is approximately equal to I, a better formula is obtained by substituting 
(I + Cl) for C. The final formulas then are identical to (10,20) and (10.23) with 
the substitution of 1 + N{Ci) for NiC). Similarly if C = 7 so that Ct = A 
N(jC) = I should bo substituted in (10.20) and (10.23). 

If A is symmetric and if C = I so that the prediagonal elements of 

Ci arc filled in by symmetry as in Table II instead of being calculated directly 
This complicates the analysis of error relations The following inequality gives 
the error limit for the diagonal and postdiagonal elements of (A“'). We have 
indicated these elements by F. 


(10,24) 


NE(F) < V'[3/2] - NjA - I) +_[NiB - I )Y/K 
^ ^ - [1 - NiA - 7)1 [1 - V2 NiB - 7)1 

NEi 

I - V2 NiB - r) 


where K is the root of (9,10) when fc = I — NiA — I) and NE^ — 0.5 X 10 X 
V pip + l)/2 by (8.3) 


11. Results. Given the matrix A, we subtract one from each element on the 
principal diagonal to obtain the matrix (A — I). By the norm of (A — 7) we 
mean the square I'oot of the sum of the squares of the elements of (A — 7). We 
shall now show that a Doolittle process such as outlined in Table I is in a state of 
error control if the norm of (A — 7) is less than 0.35: 

1. NiA - 7) < 0 35 

2. NiB - I) < 0.4642 by ( 10 . 2 ). 

3. NEiB) < 1.09 p by (10.6) and (8.2) 

if the maximum rounding error in any element is 0.5 and A has p rows. Thus no 
element of the multiplying matrices R, S, or T can have an error of greater than 
this amount. 

4. NEiC,) < (44 X p X 10“")iV(C) + (6 X p X 10 0 by (10.20) and (8 2) 

where q decimal places are carried on the left and r on the right. Thus if the 

decimal point in C is shifted so that 77(0) < 1, the error in any element of C 4 can 



I I.. -^1 n.uiiiwu11; 


mi 

t)(it amounf (n iiimh> (li;iii (lin'i' -iKniln:iiii liniiir‘< il" flip mmiliiT of dcciinal 
placf'.H canii'ti on Ixtth tin- li'ft ninl on iho ii)>;li| tfoiir ••'ipnificaiit figums for 21 
to 2tl0 low.si, 

5. A7'.'(.! ’i >' lliii-o Muiiitii'.-iiil hy .'nt)^tltnti^)^ .V(f-- 1 Miita* f,' J. 

\V(‘ lot A't.l ■ 1 1 lii‘(‘onn' Inijici lltnn l).;tr», tin- niaMinuni cirom nuliratcd 

by niir foinmlii,- i':i|iii!ly voiy la Ki*. In fai'l fliov lacortu! inliinto if 

A'Ci - 1 ] n.in. 

Since ior inoic than four ciinrilioiis the aluni' foniiiilaN !'liiivv criorrt in the 
I'ccoiifl flcciiiial iil.'icc no niiittci how ■'iitall A’CA - I) il is MinKcstcil lhal iw a 
Rciicial |ii'at‘li('c: 

1. The [ndlilcin hi* anangcil so that A7.t /) <[ 0,3.’). 

2. 'Fhc ilccinnil poinfri in f' lie .shil'lctl Mt A'(f') ' 1. 

H. 'rtircc extra ileeitnul places lie curiied in the calenlations. 

12, Preliminary adjustments. The iet|nireinent that A'(.l 7) .should he 

le.ss than ll.liri is nol nornially mid in pnietieal prolilenis. [f, however, an 
Hlipi'oxirnalion to .1 ' i.s axailahle, the prohleni can almost alw.ays he rearrantiied 
to .s'nthfy thi.s eondilion. 

Thus ii we aie .solving the ('([iiatioii' -iieli as)ii\en in 'I'alile I, 

(12.1) .l.V (T- I), 

wv are perfectly fiee to inullipiv throiinh hv any non—innulai inatii.x F without, 
di.sturhiiit^ llie .solution; 

(12.2) (7-I iV .. r/■V•)l■ t/'/l) 

Now if F is a sutlieienlly close appioxiniatioii to .1 /A 1 w ill he .a I most etpial to /. 
Tluu'efore A'(/'M — I ) will he les^ than I) IJ.") aial a I toolit tie solution of (12.2) will 
he m a state of iTroi control. 

Similarly for the inr'ersion of ,1, we can ajiply the Doolittle proee.sis to tlie pair 
of matrices 

FA : F 

jii.st, as easily as to the pair 

.1 : / 

since 

(/Al) ' il FA : Fi\ - .1 'F ' j| FA : A’ji 

11.1 : .1 \F '/>’) Il 

- II vt '.1 :.l ‘I! 

■■ II / : -d ' i|. 

Thus hy taking F as a suHieieiitly close appruxunatiou to ,1 \ we can lu'ing an 
inversion caleulal.ion into a .state of eiror control. 
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The computer should be cautioned that the multiplication by F must be exact 
and that no rounding is allowable in this step Our formulas assumed that we 
started with matrices free of error. 

13. Further work. The principles used in this paper can be applied to the 
task of developing calculation routines which will be in a state of error control 
regardless of the size of N(A — /) Enough work has been done to see that such 
routines do exist and do not involve prohibitive labor. The author expects that 
the most efficient routine will be to use these more elaborate methods to obtain 
an F such that N {FA — I) < 0.35 and then to use the normal Doolittle methods 
as outlined in section 12. 
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rtrVERSE TABLES OF PROBABILITIES OF ERRORS OF THE 

SECOND KIND 

Hy Kmma I.khmkh 
Vnivtrnlij of (Udifornia^ Brrkclnj 

L Introdtiction. Tho prohltiin rif ttwling linear hypfl(lle^eM \va.H cliKcusHC'd by 
KoUxizipjcJsyk [1], and later in grealer detail by Tang [2], vvhu etmipiiU'd a table 
giving the probabilities of errors <!f the seeond kind for a range of values of 
the two degrees of freedom/i and/a, (/i » l(l)b,/s ^ 2, 4, ti(I)30, (10, «)* and 
for two fixed levels Pi ^ .01 and .05 of the probability of errors of the first kind. 
These tables are in terms of a parameter y;, (v> =' 1 (.5)3(1)8) who.se statistical 
signifieiuice, or rather that of 

X « (/i + 

is discu.^sed in Tang’s paiier. A re.statement of the problem of te.sling linear 
hypotheses in a more ciuumieal form, giving an InterimdiUinn of X, will also be 
found in a recent paper by Wald (3). 

Professor Neynmn has felt for some time tliat a table giving s- ipin, h, a, j9) 
as a function of the two degrees of freedom/i ~ 2rt, and /* ~ 2b, and of the, two 
probability levels a « Pi and /3 “ 1 “ Pit would be more u.M'fid for statistical 
purposes, where d is the prolmhility of deteeluig (he falsehood of the liypolhesis 
tested. A paper by Profe.ssor Neymun exiilainiiig this point of view ami giving 
applications of the present tablen to .some statistical problems will appear 
shortly. These tables were, eomimted in the Statistical Laboi-alory of the Uni¬ 
versity of Oalifornia,* and give values of v>for the fcdluwing range of parameters: 

(a, d) = (.01, .7), (.01, .8), (.05, .7), (.05, .8) 

/i = 1(1)10, 12, 15, 20, 24, 30, 40, GO. 80, 120, cc. 

/j = 2(2)20, 24, 30. 40, 00, 80, 120, 240, cc. 

2. Analytic definitions. The statistical parameter 

(1) X = X(o, b, a, d) = (» + i) An, b, a, d) 

can be thought of as an inverse function connected with the hypergeomolric 
distrihuLiou. Inverse function.s t/(a), u(a, a) and i:(a, h, a) of the, better known 
normal. Gamma and Beta distribulion-s respectively have all been tabulated, 

• ‘ The notation m » l■{s)l is cguivalniit to in »=■ r, r -t- «, r + 2«, ,,. , t. 

’ Thsfift IttblcB were begun by Miss Leone (linlsler, and were carried on by Mark Eudy 
under a University of California Ilescarch (iriiiit. ’Plie bulk of llic eomputing was done, 
however, by the author and by Mrs. Julia Robinson under a grant of tlie .‘Vmcncan Philo¬ 
sophical Society. 
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and are sometimes called "percentage points” of the distribution. To begin 
with the simplest, the normal distribution, we may define y{a) as the solution of 


( 2 ) 


1 



e 


-l ‘/2 


dx = a. 


This function has been recently tabulated by Truman Lee Kelley [4] for a = 
p = O(.OOOl) 1 to 8 decimal places. 

The function u(o, a) is the solution of 

(3) jf ’ = r.(a)/r(o) = a. 


This IS connected with the well known percentage points of the x3 distribution 
With V ~ 2a degrees of freedom as follows; 


(4) 


x!(a) = 2-u(a, 1 — a). 


Catherine Thomson [5] has tabulated x»(“) for “ = .005, .01, 025, 05, 1, 
.25, .5, 75, 9, .96, .975, 99, 995, and for = 1(1)30(10)100 She has also 
tabulated [6] the corresponding parameter * = x(a, b, a) of the Beta distribution 
with Vi = 2b, vi = 2a degrees of freedom defined by 


(5) 


B(a, b) 


i 




i“~'(i - = 


Bi(a, b) 
B(ct, b) 


a 


for « = 005, .01, .026, .05, ,1, .25 and .5 and vi = 1(1)10, 12, 15, 20, 24, 30, 
40, 60, 120, V 2 = 1(1)30, 40, 60,120, m to five significant places. 

Similarly A (a, b, a, 0) can be defined as the solution of 


( 6 ) 


B(a, b) 


L 


a) 


a, -M) d( = 1 - 0 


where 


^(T) 5, 3) = 1 + I 2 + 


y(7 + 1) 
6(5 + 1) 


+ 


is the confluent hypergeometric function. 


3. Limitmg cases. It is well known that as a tends to infinity 

C7') ^ u(a, 1 - a) = j ^ q / A _ 

' V a a \aj' 

There are many approximations [7] to x*. In S' recent paper Peiser [8] gave a 
rigorous derivation of an asymptotic formula for x^. 

Similarly, the limiting cases of x(a, b, a) as a and b tend to infinity are known 
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2.417 2 150 1 966 1.830 1 728 1.642 1 572 1 514 1 464 1.422 1 346 1 256 I,15S 110 1026 
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2.193 1.963 1 801 1.678 1.587 1 513 1.451 1.400 1 353 1 313 1.247 1 169 1.076 1 02 
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(9j and fnllow readily frnm (5), alllitniKh nn altempt lias tieen madi', as far as I 
know, to find better apiirOMtiudions. 'I'liesi* iiniitint; values are as follows: 

(8) lini a[l - .r(«, h, «)) - u(h, I — «) 

n»»ea 

(9) lim bx(a,b,a) — u(a,a). 

The two eorr(‘H])oiidiiiK liniifinf; eases for X are not at first Klanee so synunetrie. 
When a tends to intiriity, we have fioin (1) 

(10) liiti ^ ~ Ip 

tf (I 


(11) lim ft, ^ — (1 + pty 

a-*ca 

Substitutnip; these in (0) and letting < = 1 ~ z/n(l + ip) and passitig to the limit 
we get With the help of (8) 


l’(h) J< 


1 (/)) J (11 v>2)u(6,a) 


o' * (/S — I ” /^. 


Ill other words 


(1 + y>-)a(h.«) - u(b,0) 


(13) •’("'‘■‘’■W- f/SiS''- 

This i.H the only case, (‘xeept for 6 = 1 in which ip can he. given explieitly, 
For 6 = 1, we have from (5) 

x(a, I, «) = -v^« 

and (6) can bo easily iiit('grated to give 

p(a, 1, «, /3) = log + 2)^1 - ^1 - a) . 

In all other cases it was found inipruetieal to attempt an inversion of (ti) to get <p. 
When 6 becomes infinite ((1) liceomes with ( = e/6, and with the, help of (9), 

(14) e-M c" M /^,(2V'Xz) (lu = 1 “ /3 


where 


7«.i(2-v/xz) 


' — lim F 

r(a) t-M 
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ie the Bessel function of a purely imaginary argument, which is usually defined by 


hix) = 


flO 


E 



rlr(n + V -H 1) ■ 


Expression (14) was also obtained for this limiting case of the hypergeometric 
distrilnition by Wishart [10] This integral, however, does not give X any more 
explicitly than the general integral (6), and since the calculation of X increases in 
difficulty as o increases, an attempt was made to derive an approximate formula 
for (p(a, CO, a, |3) for large a. To this end an asymptotic formula [11] was de¬ 
veloped for I„{nx), the principal term of which is 


( 16 ) 


Ininx) 


(1 + / Vl 3:^= - 1 ^vr+r» 

■\/2rn \ X 


Substituting this into (14) with x = 2 -s/^ja — 1 and n = o — 1 we get for 
large o 


(17) 


-u(a,l-o) 

f^) Jo 


1^—i (I—V *+(v* ^ /2o) 


d( = 1 - |3 


If we assume that is sufficiently small to neglect the term in tp we get as a 
first approximation 


(18) 

r(a) i 

or 


(19) 

vj(a, CO 


<1—a) 

V d( = 1 - |S 



u{a, 1 — 13) 
u{a, 1 — a) 


a formula very similar to (11). In fact since a is large this formula can be 
reduced one more step using (7). This gives 

(20) lim ■\/~atp{a, = yia) - y(fi) 


Similarly (13) becomes 

lim b, a, (3) = 2/(“) - viP)- 

b^op 


If instead of neglecting the term in (p*, we multiply it by the value of t at its 
upper limit, we get 


(21) 


2 1 — \/ l — 2[n(g, 1 — a) — u{a, 1 — ff )]/a 

' M(a7^r^-^a)7o 


Professor Neyman derived another approximation for tp{a, ^,a,p) by assuming 
that the distribution (14) approaches a normal distribution for large a. He 
obtained: 


V 


2/(«) + 


y3& 

\/ a 



+ 




( 22 ) 
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Both (21) and (22) obviously reduce to (20) in the limit. The following table 
shows the efficiency of these formulas for a = GO 



Table 

(21) 

(22) 

(20) 

a » .01 
p = .8 

.687 

.695 

.668 

.640 

a = ,01 

P = .7 

.647 

.(>42 

.622 

.607 

'« = .05 

P = .8 

.603 

.585 

.593 

.566 

p 

11 

ts 

.557 

.540 

.544 

.529 


\/3 = .7 

A rigorous derivation of .some .such formula giving the actual order of approxima¬ 
tion of v> would of coume be of interest, but is likely to be, (luito complicated. 


4. Calculation of tables, It is fairly obvious that the, integral (G), although 
very useful theoretically is not well adapted to actual calculations. It can 
easily be integratiid by parts to produce the infinite scries. 


(23) 


-0 V Bi..i(a + 1, &) _ „■ X Y' 

M zl S(a 4- i, b) i! B(o + 1, b) 


X' B,(?i. a + i) 


= 1 


i3. 


This series can be u.sed effectively for calculation purposes only if X in compara¬ 
tively small. If b is an integer, however, thi.s series can be replaced by a finite 
series of b terms, which was also used by Tang (2] in calculating his tables. 
This series is as follow.s with a: = z(,a, 6, 1 — a) = a:(i!;, a, a ): 

(24) e”^*(l - E T, = 1 - /3 


where 


To = 1, T, = x[X(l - x) + a+b - 1]/(1 - x) 

and’ 

(25) Tn = a:([X(l - x) + a + b ~ n] Tn-i + Xa:r„. jl/n(l - a:). 


The subjoined tables can be thought of as inverses of Tang's table's, and could 
have been obtained from tables such a.s Tang's by inverse interpolation, had the 
interval of tabulation been sufficiently fine. Tho interval of tabulation of .6 for 
<p allowed only a crude approximation or trial value of <f>, the corresponding 
probability was then calculated for this point, and then corrected with the help 


• It will be noticed in comparing these formulas with those given by Tang, that x is used 
for 1 — X, This is done to conform with Miss Thomson’s table for x. 



TABLES OP PROBABILITIBS 


397 


of derivatives. In the beginning of the work, a recalculation was usually 
made for the corrected value of <p, and the tabulated value of <f> was then obtained 
by inverse interpolation between these very close values, As the work pro¬ 
gressed, and difference tables were calculated in several directions, the guesses 
improved considerably so that a correction could be made using the first deriva¬ 
tive to give a tabulated value of ip correct to three decimal places. Such corrections 
never exceeded .004, and therefore it is hoped that the tables are correct to the 
last place. The derivative in question is given by 

(26) ^ = (2a + l)^a:(l - , 

and was obtained as a by-product of the calculation of (24). This method was 
used for all finite a's and for all 6'a less than 30. For 6 = 30 or more it was 
found more expeditious to use the infinite series (23), about 20 terms of which 
sufficed. 

The values of x(a, b, 1 - a) = a:(b, a, a) used in these calculations were ob¬ 
tained to five significant places from Miss Thomson’s table [6] for a = .01 and 
.05 with vi = 2a, vn — 2b. 

No calculations were made for non-integer b’s since for small values of b, 

X was too largo to make the infinite series (23) practicable, while for b ^ 7, <p can 
be easily obtained by interpolation. The only available method for calculating <p 
for b = 1/2,3/2 or 5/2 would be by numerical integration of (6), which would be 
rather lengthy. Furthermore, the interest seems to be in large rather than small 
values of a and b, 

6 . Calculations for infinite cases. The case o = w was readily disposed of 
using (13), as for b = «>, the integral (14) was again integrated by parts to give 

(27) E (J) /^.(2\/nX) = 1 - 

This was found to be effective, especially when u < X, which is the case for small 
values of o. When u exceeded X, the complementary series was used, namely 

(28) ^ j = P- 

The calculations proceeded in much the same manner as in the finite case. The 
values of 2u were obtained from Miss Thomson’s table of percentage points of 
xl (ct) distribution with v = 2a degrees of freedom, while the values of lo and h 
wore obtained from the tables of Bessel Functions [12] for 2 < 20, and from 

the tables of Anding [13] for larger values of the variable. The values of I. for 
V > 1, were computed from the recurrence relation 

' _ cosh 2 

* If o ia an odd integer, the valuea of can be built up using (29) from (z) = 

and Zj(z) = , which of course are tabled. 
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( 29 ) 


J,4i = Liz) + L-iiz). 

2 


Future ralciulationn of this sort cuukl make u.se of the forthcoimiiR tablcH [14] of 
Liz) for t> < 20, and z < 20 to ten signifieimt plaa's. A.s befort*, tlie tabulated 
vnliiea wore obtained tiy eorreetiuK trial valuc-s of <,'> by meanH of the derivative 

(30) = V2w(2« + (j-J” '^''l(2Vu\), 


which again wa.4 oiitained uh a liy-produet of llui oaloulalionM. Tins method 
bccomea impractical when a ia too large, beeauae a great deal of accuracy is lost 
in applying recurrence (29) many time,s. For .some of the larger value.s of a it 
was found preferable to u.se the .sorie.s 


( 31 ) 




x' r«(o d- i) 


ti rl r(ft + i) 


although it converge.s rather .slowly. In other w urd.s the upper limits for o and b 
were pu.shed a.s far as wa.s practical ilc. 

The values which arc tabled to two instead of three, deeimals wi're interpolate 
using second diFoveuces, all other value.s were eumputed in the manner dcrscribed 
above. DiForenei! tahle.s were made by rows, eolumns and between tallies, a.s a 
final ehcck on the work. DiFereiiee talile.s u.sing harmonic inti'i’iiolatiou were 
also made for both rows and column.s, and found very eFectlve, with the eveeption 
of the lowcaright hand corner, whore ip drop.s rapidly to zero. Tho last column 
of each table is to bo used for harmonic intorjiolation. 
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SOME COMBINATORIAL FORMULAS WITH APPLICATIONS TO 
PROBABLE VALUES OF A POLYNOMIAL-PRODUCT 
AND TO DIFFERENCES OF ZERO 


By L. C. Hsu 

A'aitonal Southwest Associated University, Kunming, China 


1. T'lu; main piirjioHo of the paper is to establish some combinatorial formulas 
concerning the niatlieinatical expectations or probable values of a product of 
ft Kiven polynomials, Tiie problem may be stated more definitely as follows; 

Let xi, ‘ , Xn bo ft non-negative discontinuous variables for which we have 

assumed (hat the probability that each x takes a possible value is equally likely, 
and let /i(.r), • • • , fn(x) be ft given polynomials. Then we shall ask: What 
is the probable valuo of the product/i(ii) • fnixA, provided the sum of the 
variabh'.s .ii, • ■ ■ , Sn is known? More generally, we may consider the problem 
with certain in.'-trictions to x such as a < a, < Zi, = 1 • • • n). 

By a limiting process' it wilt be found that all the formulas established for 
the pri'ceding problem can be extended to the case of continuous variables. 
On tlii.s ai'cuunt, it is important to find explicit formulas for the problem merely 
involving di.seontinuoua variables. 

By tho deliniiion^ of MacMahon, wc say that a set of numbers (xi • • ■ x„) 
is over all diffon'iit compositions of m into n parts with each x > k, if (xi • • • x„) 
runs ovci all difforont integer solutions of the linear equation xi • Xn = m 
with cacli X > A;. Wc shall use the notation (m, fc; xi • • • x„), or simply {m; 
k] :r), to (h'liotc that a .set of numbers (xi • • • x„) is over all diffeient compositions 
of m into n jiarl.s with each x> k. 

Tilt! notation Sim-,5-, [/i(x)] • • • [/„(x)]) will be used to denote the mathematical 
expectation of tho product/i(xi) • • • /n(x„) in which the sum of n variable quanti- 
, tics .ti, • • • , x„ is known, namely xi -f- • • -|- x„ = m, and each quantity is a 
muUiiilc of 5 and vi is of cour.se a multiple of 5. Thus by the definition^ of 
malhcmalical expoctation.s we have 


( 1 ) 


5; [/,]■’ • [/J) = 


( E l) ^ E ••■fnix„5), 

(m/5,1;*) 


where the summation on the right-hand side runs over all different compositions 
of m/s into n parts with each x > 1 , and the given constant 5 is called a “varying 
unit’*, that is the least possible difference between two unequal quantities in 
(Xi *' • x„). If tlu! varying unit approaches zero, (xi • ■ • x«) will become a set 
of continuous varialilos 


‘ Till) limiling prorcsB will bo illu.itrated by the proof of corollary 2 of theorem 1 in this 
paper. 

‘ MncMahon, Comhinalnry Analysis, Vol I, p 150 
a See for example W. Burnside, Theory of ProbabiUty, Chap, 4,13 
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If /i(®) «•••=! fn{x), we may write 

E(m-, i; [/]") instead of E(m; 6; [/i] • • ■ [/„]). 

A well-known convention for is also adopted here; 

ml 


(:) 


nl (m — n)l ’ 
0 


if 0 ^ n m, 
otherwise. 


2. Lemmas. In order to obtain explicit formulas desired we first establish 
four lemmas as follows: 

Lemma 1. Let m, ri, ■ • - , Th be non-negative integers. Then 


( 2 ) 

Phoof. 


2 n (!')-(, , 

(njo,*) r-i Vr/ Vi -p •' • + r„ -t- n — 



Construct a generating function: 

\1 — x) \i — a:/ ’ 


|a:| < 1. 


It is observed that the coefficient of the terra a-”’ expansion of the 

above product is given by 

^ Ai + *i\ /fi, + SuN SB V • •' ( 

Cm—ri— 1 •—r»,0ii5 \ / \ Xn ) Cm| 0; *) Vi"!/ \*'n/ 


On the other hand we see that the coefficient of the term jn the 


expansion of 


(,-^j 


is given by 


\ m - (ri 4- ■ • • -f r„) / \Sri n - l) 


Hence the lemma. 

Lemma 2, Let a, b, c, • be arbitrary constants, and ki, h , ks, • ■ ■ be positive 
integers. Then 



Proof. Expanding the left-hand side of (3), we see that the coefficient of the 
term a‘‘l/c'' • • • is equal to 

nl y A“*-A ... ^ ...{ ®«+/3+T^ 

aliSlyb ■ • (mi^x) \W \h/\kt/ \kij\ ks / \ h / 
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By lemma 1 it is reduced to 

OT + n-1 \ 

al/Slyl ■ \ah + fiki + yh+ ■•• + n - 1/' 

Substituting, we get the lemma. 

From now on, we shall frequently writeinstead off(x), so that 

/■Y’ ++• ■ •+ (j)iv - (/+,)<■>. 

Lbmma 3. Lei m, n (< m) he two positive integers. Then for any given poly¬ 
nomial f(x) of the kth degree we have 

(4) S ••■/(x„) = n! 2: ( 7 + "- 

(mlllJf) (<u5!^p) \^(p) + «• — 1/ p,l 


= fix), Sip) = 1 -pi + • • ■ + k-pt . 

Proof. Since fix) is a polynomial of the fcth degree, there exist ik + 1) 
values pk ,00 such that 

4 - • * • + + ^0 = fix). 

By putting ® = 0,1, • • • , it, we find successively* 


( 6 ) 0 > 




+ ... + 




(v = 0, 1, • • • , fc). 


The lemma is thus obtained by means of (3), 
For convenience, we denote the summation 


Z) fiixi)---fnix„) by Sim,[fi]-- [/„]). 

Thus formula (4) can be rewritten: 

’ V'Pi + ' ■ ’ + fc-p* + n-1/Pol pil PkV 

whore 0o ,0i, • ■ ■ , are given by (5). 

Lemma 4. Let fiix), ■ • • , f„ix) be n given polynomials, Then 

(6) Sim, [/i] ■ ■ - [/„]) - i r [/,. + • ■ • +fnn 

* Strictly speaking, the relation (6) is eBtablUhed and proved by induction on n, in 
which a well Icnown combinatorial equality is applied. 
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wliere the summation on the right-hand side uuis over all different combinations 
out oj {I • ■ • n), (k = 1. ■ ■ ■ n). 

For cxiinijilc, if n - 3, then all the tlilTcrcnt cninhiruitioriH out nf (123) will 
lie: (1), (2), (3), (12). (13), (23), (123). 

Proof. Cuiwidi'r a. lyincal term 


<?i! 


Id 


iff, 


iff.n, 


where 1 < 1 < n, • + ?< — a. Now a iKH't"iHary and siifiioumt condition 

that the term will be contained in the expansion of ,S'(?)i, [/p, 4 - ... -f /^J") jg 
(vi ■ • • i',)e(gi > ■ • fn), i.c. (n ■ ■ ■ Fi) i.s a eoinbination out of (pi • ■ ■ p*), and for 

a lix«l k, tlicre are _ ^ydifferent coinbination.s of (pi • • • pi) aatrsfyinR the 

condition (ei • ■ • r()«(Mi • ■ ■ M<r)«(l • ■ a)- Therefore Ihe number of occurrencea 
of the term in the right-hand .Hide of (G) i.s given by 


n —I 





/I II if t ^ 7lf 

^ ' "" \1 if t - n. 


The term, vanitihc.s gctu'rally except qx- • • • -= r;. ~ 1. lienee, the right-hand 
Hide gives tS'(?M,[/il ■ ■ • [/nl). 


3, Theorems and corollaries. In the, following statement of theorems and 
corollaric.s the notation (.ri ••• x„) will be alway.s used to deiiole. a set of unde- 
tertnined quantities as Hpee.ified. 

Tiieoukm 1. BupposG that (xi • ■ • .tn) is a set of natural numbers in which only 
the sum of the numbers ts known, namely .ci -f- • • • = m. Then, for any 

given polynomial f{x) of the klh degree, (he mathematical expectation of f{xi) • ■ • f{xn) 
is given by 


m, 1, f/]") 

= „1 (m - ly y / m -f a - 1 \ [(/ - 1)‘“Y" • •; [(/ 

\n — 1/ (n.o.jj) \<S'(p) -p n — 1/ Po! • • ■ p*! 

Proof. Let m' = m -p nr. By lemma 1 we have 

S 1= i: i = + 

(pi;0,#) CTrt,0;jc) (m',r:x) \ H ““ 1 f 

This is the munlier of compo.sitions of m' into n iiarls with each part > r, In 
particular, if r = 1, wo find that the, number of conipo.sition.s of m into n parts is 

— ly required value is equal to 

{S(m, [ID !“^S(m, [/D, i.e. ” j)"‘-S’(m, [/D- 
The theorem is therefore proved by lemma 3. 
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CoROLi,ARY 1. Jm (xi ■ • ■ En) be a set oj positive quantities, of which the 
varying unit is fi, and the sum is m. Then, for any given polynomial fix) of the 
kill degrrr, we have 


Him, b, 1/]") 

( 8 ) 

~ n! I \ 5 / 

\ n — 1 

where 



S{p) + n - 1/ 


[(g - i)n"° [(y- 

Po! • • • ptl ’ 


g(.E) = f(xs), S(p) = Pi + ■ + kp,. 

Proof, It follows immerhately by the relation. 


Him, 5, [/(x)]”) = E , 1, [/(fix)!") . 

CoHOLl-AHY 2. Let (.Cl • • • a'„) be a set of non~negativcly real numbers, of which 
the sum is known, namely .xi + • • + = m, m being a known real number. 

Then, for any givm polynomial f{x) = ao + • • • + aix\ [ai 0) wc have 


Him, 0, [/!") 

(9) ^ _ (Q!ao)°° 

n (n.o.j)) (I'gi + • • + /cgjt + ?i — 1)! go! gi,* 

Proof, Tho proof of tho corollaiy depond.s p.ssontially on the concept 
that two iin(!<[Uiil real niunh(!r.s may differ by an arbitrary small number h, 
Ijfit h be an arbitrary positive number and W'rite f(xh)/h'‘ = gix, h), where 
the nuinlKir k is the dcRree of fix). Then, since 




E(-i) 



in 


wc may write 

giv, h) - oiv - 1 , h) + 


0” = 


i(” t ‘ 


if p < n 
if p = n 


if p = w + 1, 


+ (-iyQg(o,fi) = 


ir''{v\a, + h-Ii..ih)], 

V — Q, 1, • ■ • k, 


where 
lim Ryih) 

li-»0 




4 - + 



rlOp+i . 



m 


h. C. IIHIJ 


Now we pass to the limit /i —+ 0 in whuiU wc lussvime that h rims through a sequence 

ttl 

of real numbers of the form ^ , N being a natural lUimlK'r. Tims iiy corollar 7 1 
we have 


Urn E{m, h, [/D 
^-•0 


= u! Um 

;i-»o 



(r!a, + h-K{h)}['_ 
A'* -p,! 


2 

tnWji) 




lira 



+ n ~ - 1)1 - n) 


(«(rt+»-l)l((^)-iw)!((7)-l)l 


nl(n - TVCslaO"' 

M (S(pr+ n - 1)1 v»-0 Prl 


lim IT ir ^’^ ‘•0’')^' 

"pVr 




(iS'(7J) = I'pi + ■ ■ * + k-pk). 


Hence the corollary.® 

CoKOLUARf 3. Lei (xi • • • s„) he a eel of positive real nunibers under a known 
condition o ;< *1 + ■ • “ + where a (< b), b arc two positive real numbers. 

Then, for any yiven polynomial fix) =s oo + • •' + (a* 0), llicmalhemahcal 

expectation of the product fixi) • • • /(*«) which we denote by EUab), 0, [/)") is given 
by the formula 


( 10 ) Em, 0 , m = 


nl(n — 1)1 




6 — a 


tto" 


(1 + S{q)).in ~ 1 + S( 3 ))! 

_(fclaOT* 

?o! •• • j*! 


(Siq) = ■ 4- kqk). 


Proof. Since the probability that the sum of xi , • • ■ , a:„ takes a value 
between a and b is equally likely, we sec that the required mathematical expecta¬ 
tion will be the mean of / E(u, 0, [/]")du, that is 

••a 

Em, 0, [/)")«^ £ E(u, 0, m du. 


‘ This corollary can also bo proved by meaiiH ot IJiriclilet's integral. In fact, the right- 
hand side of (9) is given by the quotient of the two integrals; 

if ■■ f fixi) ../(Xn)dxi., dXn)/if .. fdx\ clXn), 

the integrals being taken over the region: xi + ... + xn = »i) xi ^ 0, , i, ^ 0. 



SOME COMBINATORIAL FORMULAS 


405 


S’SS it“y V-'.t'“ ® 

On tho other hand we find that 

0. [/]”) = E(a, 0, [/]"). 

T, lu9 sliows thut tKc corolloiry 2 ctm be filso deduced from 3 
THEOUKM2 (A Renemlization Of theorem 1). Lei^x), Mx) be n given 
polynomials wh o.sc ckgrccs do not exceed k. Then we have 

®(m, 1, l/il ■ ■ ■ [/„]) 

no / m + ri - 1 \ 

^ = y: r ^_ir-‘V®±iL- vttKA...,. - ly^' 

(..-..fta-n) (ifp) ^ '* M-’ 

where 


f>x n + ■ • ■ + fy,(x), ^(p) = 1-pi + . . . 4- fc.p^ . 

Proof. In the proof of theoiem 1 we have shown that 


Hence, by similar reasoning and lemma 4 we obtain 

^(.m, 1, l/i] . •. [/„]) = “ I) [/i] • •. [/„]) 


. oy ,v >gK[/M+•••+/>,]") 

~ 1 / 

/ m + n — 1 \ 

(Kl" •»,)<(!•.-n) (n,0;p) /Tfl _ 

V- 1/ 


- 


Theorem 2 is proved. 

CoiiOLLAHY 1. Lei She a varying unit. Then 


JJ K/m- >< ~ 1) 

1—0 Pj 1 


Axmii.f/i]••• w) - i: z ( 

••n) (n;0ip) 


\iS(p) + n - 1/ 
Vn - 1 / 5^_o p, I 


V +n- 1 



I.. ( . H" *• 


gAx'i ■ f,(.rS\ti' - 1 ■■ li, nii'l </,. (, ! '■ ! 

I’kook. 'I'lii'- is tiivial In-i-.ni-i* ni 

Kim, 0 , I fsi-r i] • • • ! ']> ‘''’’iy 

CoHOi.i.vin 2 / I'liy nii<i titnu pu^ihu rmi nitmixr in, in hmr 

(13) K(m, 0. |.r’"l ■ • • !/1) - ' ’ ‘ ‘ 

i)<x I - ■ • 1 /A. t a • Ik 
PaooF. liy .’I iiassHKi' Iti (lie limit • (1, wi- p'l 

lim E(m, S, [/i] • • • |/„!t -■ lim Kim, A, !/,, •}* •' ■ -|- 

A “ ^ h & *‘1 li I 

-- *“ y* li"! Kim. A, [/., r,]”), 


Pt> - 


Eim, 0, [/il • • • j/J) r,. 


Kim, 0, 


The I'linillaiy is then dediu'i'ii liy CiM. 

ThkokIvM 3. (Further K‘'ii»'rulizii(iiiii nf theureni ]j, l.rt (.n x„) hr a i<cl 

of arbitrary inU yi rn ri Klrirh tl tn tin rnuilitnms: 

j-i + • • • -f 4-„ • HI, u < ./•, '' h, 

where m, a, h are all knoirn inlryirii. Thru for any ymn ixilynoinial f{x), (he 
malhcmnlieal rxpeetation of the product f(.r,i ••• fij„} (hnotril fn/ K (hi, 1, [fl") 

1(1,II) 

is given by the following 

\gY\hr ') 

(14) £ (^«. 1, [/D = . 


g{x') -- fix h), hix) - fix -I- a — 1), hi' = m - (a - Dh, + (a — b - l)r. 


Phoof. I lefiTie 


Eim, [/]") ~ 0 for m < n ami K(m, [/]'*) 


• Tills can also lie ilptlucptl by JbnchlrL's jiilegrals. 


0 for HI > 0, 
1 for m = 0. 
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\Vc shall show that 

t (-1)' W Sim', 

KebO / 


2 fM --fM, 

(xi In) 


whoi’c on the rlKht-haud side of the expression the set (xi ■ ■ x„) under the 
summation runs over all different compositions of m into n parts with each 
a < X, < 6, (i = 1 • • • n). 

W'ti denote the left-hand side of the expression liy ©, then by decomposing 
Sim', [wri/il" ') wehave 

S = E i: (-1)' W Siiri, [fix -b h)Y)Sim' - m, [fix -f- a - 1)]-^) 


Let /(.Cl) • • /(.f„) be a term contained in ©, i.e. xi -f • -ff x„ = in, xi > a, • • • , 
X„ > a. And mc suppose that x,, > 1) -f 1, ■ • , Xn ^ ^ + I, where v, ^ v, 
if i ^ j, Then it i.s found that the number of occurrences of the term in 0 is 
given by 


fO if t > 1, 

if t = 0. 


This shows that the term /(xi) • • /(fn) of © generally vanishes except a < Xi 
< 1), lienee we have 

©= E 

(ll Ir) 


N(«xt, we. .shall find the number of compositions of m into n parts with each 
a < X, < t), 1 . 0 . the, numlier of terms in © By the result just obtained we see 
that the number is given by 


EE(-irMEi E 1 

v =0 m—0 v/ (m'—m,l,r) 


— fh — l 

- r - 1 



Hence the theorem. 

The thcorom ju.st pioved shows that the mathematical expectation 
E im, 1, [/]'*) can be expressed by Sim, [ff]') and is therefore expressible in 

tenn.s of the linear combinations of the coefficients of the polynomial fix). 

Louollakv 1. LeL dhea varying unit for which ^ are all miegeis. Then 


E (m, 5, [/(x)]") 


S {j, I, [/(5Ji)l’ 

(It 


’ See lemmas 3 and 4 




h, C. IIHtJ 


C 0 ROU.AEY 2. Let fiix), • - • , /„(j) ht H given pohjnotninh. Then 

E (m, S, {/.I . • - [/„]) - £ ‘ E (m, 5, (/„+'•■+ /„]"). 

Corollary 3. The number 0 / compositions of m into n parts with each a, < x; 
£ 6i, (i =■ 1 ' • * r) is equal to 


+ R' 


(tti + • • • + flu) + («i -- 6i — l)vi + • • • + (Oft — 6„ ~ 1))>, 

n — 1 


„ ~ 


Proof, We have ahown that the mimher of compoaitions of m into n parts 
with each a < x < b is given i)y 




, /n\/m ~ (a — l)n. + (a ~ — l)v 

VvjV n-1 


Hence the number of integer solutions of the equation 

Xu + • • ■ + feint + • • • + x,i + ■ • • + x,„. - m 
with each a, < Xfu < = 1 • > * s; g = 1 • • • n,) is given Iiy 


z t--1<.-!)■“ ■"■iif 


I'i—0 


fm( ~ (a< — l)n{ -f (fl< 


£ ••• £ 

I'l-O V»/ 

■{ z n(”““ 


- - l)r< - 1^ 


mi - (a. - l)ni + (a, - - l)»<j - 


n, - 1 


‘'E 

... Vi/ V./ 


/m ~ 1 - £(ai ~ l)ni + £(ai- bi- l)n\ 

\ ni + • • • + n, — 1 /' 

The corollary follows at once by putting ni » ■ • • » n, = 1, s ■=> n. 

The last corollary may be restated as follows: Ixit there bo n stores, 
h, bn being the numbers of stocks contained in 1st, 2nd, ■ ■ • , nth store 
respectively. Then m stocks containing at least a, stocks of the ith store can bo 
taken from these stores in 

r_ 1 V 1 +-I'n /"i + ^ ~ 1 ~ 22cti + E (fli “ i'l " DnN 

^ ^ \ n~l ) 

— different ways. 
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We have now established several combinatorial formulas concerning the 
mathematical expectations of the product- ■ • Mxn) under certain condi¬ 
tions. Apparently, there are many examples which can be solved by means of 
the results just obtained. For brevity, we may state a general criterion as 
follows*. The mathematical expectation of a function, F{xi, ■ • , x„) say, can 
be estimated by the above mentioned formulas, if and only if 1) the sum of 
, • ■ • , a:„ is known, and 2) there exist n polynomials /i(a:), ■ • • , f„{x) such 
that F(xi , • • * Tn) is proportional to {i = 1 * ■ • n). The undetermined 
quantities in (xi, • • , a;„) may or may not be continuous, if the quantities are 
discontinuous, the varying unit is necessarily known. 


4. Convenient formulas for differences of zero.® 

Given f{x) = /3o -b fiix -b • ■ ■ 4- &kX^ifih ^ 0) we may write 

(/- 1)^'’ = = S,S.A0‘, 


where S,,, is a Stirling number of the second kind, as used by Jordan and defined 
by 

vis,., = Ao'= 

A'O' being in the language of the calculus of finite differences, "a difference of 
zero”. 

In terms of the differences of zero, the formulas (7) and (11) may also be re¬ 
stated as follows: 


mrr, 1 rri”'! - V (w + n - l)!(m - n)lnl(n - l)l 

I, ijj ; - _ i),(^ _ l)l 

X n —, -b • ■ ■ -b 

p—0 'Pvl 

F(m, 1, [/,]•••[/„]) = S (-1)”"' 

("i •’ll ‘ (1 • ") 


( 11 )' 


where 


y' (m n — 1)! (m — n) I (n — 1)! 
(n^p) (m - ^S(p))l(/S(p) + n - l)l(m - 1)1 

xfl-AB,A''0’ + +B.A''0Tb 

i)-=o Pji! 


= |9,o -b ■ ■ + = /3i« -f • • • -b /SnM , Sip) = 1 -pi H--b fcps. 


‘ The methods for obtaining convenient formulas for dilToroncaa of zero aa stated in the 
first part of this paragraph arc similar to those used by Paul S. Dwyer m his paper "The 
computation of moments with cumulative totals,” Annals of Math Slat , Vol 0 (1038), 
pp. 288-303. 



I,, c. Mst; 


m 


Tliofttnimlah (7)' utn! (11 s' ti'll us tluit ihfrlilTi'n'rK'o of stern plays lui important 
rAle ill file raleulatinii of niatheiiiHliettl exfiertafinns of a polynoinial product 
uiuler kiinuti enntlilinn-. (In arcnmit of tlii*' farl, wi'ure imw Rtiing to iiivestifratn 
ROine nTunerice lelalintis alul fippiuxiniiilitiiis for the differeiiees of zero. 

A.s m is larger (liaii I, we inay liiiil a eonvcriieiit reruneiii'c relation as follow.^ 


A'^ir 

m! 


* if i 


(ir.) 


A^cr*'" 

m! 


+ wo (”•+/), 

+ hit + 1) ('" ++ j) + ■ ■ ■ + >>..'(1 +1) ("'al'+t')' 


’w.Mfrtl 


whore 


(/*!■ j)X)_i(f) +i'X,(0 -■ X,fl 4 1). Xj Xj,i(f) ' d. Xi(0 ■ Xi(i! 4" 1) ^ 1, 

and Xi(0i ' ■ • . X((0 are all indepeinlent of m hut depeiidinn <"i (■ 
vStni'liiig with the first equation of (15) and usinp a well known lelatkm (due 
to Jordan) »S'm,„n ~ .S'„ i.„ -h miee.e.sslvi'ly, we gid 

m 

^rntm+i+l “ 2!^ *4" (1-1'*^ 





H 1 

z 

;e»l 


m 4" t 4" 
< 4- i 4 


0- 


The recurrence relation thus follows. 

By .succohsivc applications of the relation X,(< 4" 1) = (f 4“ j) 'X,,-i(/) 4* i'X,(t), 
after nth time say, we may e.\pivss X,(f) as ti linear combinution of X,(f — rr), • • ■ , 
X,_n(t — n), hut the coe/Iieients are, too complicated. 
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I'or i < 9, by applying the recurrence relation as obtained above, the coeffi¬ 
cients may he exhiliited as follows: 

1 Ul) Ut) >4(0 x,(i) x«(d x,(/) 

1 ~ 

2 3 

3 It) 15 

4 25 105 105 

5 50 490 1200 945 

6 119 1018 0450 17325 10395 

7 240 0825 5G980 190575 270270 135135 

8 501 22935 3n2t)y5 1630035 4099095 4729725 

9 1012 74310 1487200 12122110 47507460 94594500 

For example, when i — 4 wo have, according to the table: 



Wo .sliall now proceed to iind some approximations for and 

Firstly, ve may write 



According to the rccuirencc relation wc have 

(i) X,(0 = ( 2 ( - l)Xc_x(t - 1), 

(ii) X,-i(0 = 2(i - ])-X,_o(l - 1) -t- a - 1)-X,_i(i - 1), 

(iii) Xt-id) - (2i - 3)-XUt - 1) -h (i - 2)-\,.,{t - 1). 

Hence 

UD = \ut) = (t- 1)!2‘-V(t), 

wo = 2‘-‘ i: (t - 2 - j)!(t - 2 - j)-{t - 1.5),.(1(4 - 1 - j), 

,=o 

where 

- E -|i , (t - 1-5). = (i - 1.5) (t - 2.5) ... (t - i - 0 5) 

Evidently, the orders of ^ — 0 ’ ' " ’ C l) 

n tond,s to infinity. 


XiO) Xg(0 


2027025 

91891800 34459425 
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Now, it can bo easily found that 

-|(0O + O(--r;a)'(-“7,.'O 

+ H-Ofi 




^ 2‘-£! /n + A 

n - £ +‘iV 2£ 


()n“ 





2’'£!j| 
fn - £ + I). (2£ 




X(-j(£) 

Honco, we may write 



(10) HI- 

where 





1 + ? + - i + 0 

n n’ 



1 


pi = ( + 2 




Pi 




t-til). 


Moreover, it can be sliowu by Wallis’ formula that 

v1' (*-1.2,3, 

Thus we have 

'® ” s I-. C') < s / Vi * - 3:y-j-1) 1 
'® - 5 2- (?) > s t/? > r /i - A »- '>'• 

Again, by Wallis’ formula we have 


•). 
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Combining these inequalities we get 

((- 2)1 < 4' (^y »(i) < _,), 

where 

Vi ((- 2)' ~ ((' -1) ~ ii’. 

Therefore, 

i + WtVf^^ < PI <i-\- lVr+1 {Vf - 1), PI li 
Next, by Stirling’s formula 


wo obtain 


nl = 






where 



i+H 




Si — Pi "i" 

Si = Pi-\- r^pi + -ih’ 
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RANGEvS AND MIDRANGES ' 

HY H. J. {JfMHl.I, 

Xiii' SrhiHit Ji>r Stii'inl Risnurh, Afic Voik ('iljj 

1. Introduction. In the i‘nlhn\iii(j; llie Kciu'infing liiin'tioiis nf f]ii. fxlicino.s 
arc .stntlici! in nitlcr tn ilctcniiiiic the natiiu' nf the (h^tnlinlinnv nf Ihc ranucs and 
the nlilh^U)^!;c^. 

A catniib' nf ‘■r/c » cnii'-idercd (n In- lieavMi finiu an iinliiiiitcd .symmetii- 
cul eniitiminU'' tli>tnhulin)i with J:ent im-an 'I’lie ililiVii'iii-c and tlit* -sum uf the 
largest and nf llic .sinalle^t ulc'ervatinii, tlie extiinncs, am called mni/r and 
niitlmiKji’. U A. Ki.'-hci and I.. II, ( 'riinictl |dl ha\'c c.'.ttddidicd the limiting 
di.stiilailinne nf flu* largi'.'-t and nf tlie .'•iiiallc.'.t ineinlicr nl a Miiniile. The exact/ 
enndilnin.'^ under x\hicli the.'-!* ili.-'tiiliniinn.- hnld h.ive Iiceii gixim hy U, x-nn 
Miecs [ll. For a nnnnal distiilmtinn, L 11 Tipiiell jTl has calculated the, 
luunei'ical values nf the mean range and the liml fniir nmnienls nf the range for 
.«atni)le sizes vaiying fimn 2 tn HHUi, lie iui" .shown that, for .s.-unjile .size.s 
exeei'ding 2(H1, the enrrelatinn hetween tin- hugest and the siualle.st nli.servatinn 
niiiy he neglected hater, hi. S. I’eai-nii j,'i| has eidciilated the lu'nliahility 
fuiictinn nf tlu' range for .small .samitle.s tn - 2 to 2ll) taken I'mm a iiniinal 
pnimlutinn, I'hc.se calculalinn.s are veiy lahniimis Hei‘enlly, W Jv Dealing 
[11 has applied the lange tn ([Uality cnnlmh 

'I’he enneepts "extrciucs”, "range" and "inidiangc" allow a .simple geiieializa- 
tion. la'I ,„.i and x„, he the nitli nhscivalinn in increasing and in decreasing 
magnitude, hencefurtU called ndh value "frnm helnxv" and '‘fuuu uhnve". As 
Iniig as the index m is small cniiipamd tn the sain)ilc size «, the ndh vahii’S under 
cniisideralinu are <',\lremes. Tlie dilfeieiiee and the sum nf the ndh extieme 
oliservatinns are called thi' intli rntiijt' and the ndh miilnmyc ^^’e will invi'stigale. 
the asymptotie distrilnitinns nf the with extremes, of the ndli range, and nf llui 
Kith iiiidiange A.ssuniing tluit the munlu'r of nhservatiniis is very large, the 
cnrielalinn between the largest and the .smallest nliservatinii may he neglected. 
Then the with range and the iiith midrange ai(‘ tlu' diflereiiee and the .sum nf two 
indeiierulent variates, the nttli extremes 

It was found that the dislrilmtinn nf llic »ilh range is skew and the distrihution 
of the rath midrange is of the geiua-ahzed logistic ly]ie, which is symmetrical. 
For 7n increasing the distriliutions nf tlie mill exlremes, the mth rungc.s, and 
the mth inidranges eonviu'ge Inward normality. 

2. Generating functions of the mth extremes, 1,(>I ip{x) he an iiiiliul con¬ 
tinuous .symineli'ieal (listrihulion with mean zero; li>l ho tlm most- prohahlo 
mth value from ahov'e; let «„i lie didined hy 

0!m ~ 'iP(Wol). 

tn 

' llcaoarch dtinc willi the aupiiort of a grant from the .Vinenciui Pliil(i4<i|)hit'al Society 
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Under conditions Riven in an earlier paper [3] the distributions and„/(„a:) 
of the •mtli extremes arc, for larpc n and small m 

(2) UM = a. JU) = u-x„) 

whei e 


(3) l/m ^m(Xm Urn) 

is a reduced exlreine, wth value. 

T1h‘ inoineut generating function Gm(t) of the mth extreme value from above 
obtaiiK'd from the preceding equations is 

A-l-eo 


"■<« " cT? w I 






Introducing 


e = 2 


the integral liecomes 


r = r (m - 

Jo \ 


?n 




wliencie. 

(4) 


cuo 


= e""‘w"“’"r j 


r(m). 


To obtain tlu' moments of the mth extreme value from above, the fundamental 
properly of the (lamina function is used; whence 

I 

„_i m — r — — / . \ 

Finally, by rever.sing the older of multiplication the moment geneiatmg function 
of the mth extreme value from above becomes 


(5) 


(;„.(0 


_ -U/nniX^riOn+fO"*) 


n(i- 


'■J’lu! mean r„, of the intli value from above obtained from (5) is 

1 / 1 \ 

«!) I,''”* “ S+ d 

where e = .57722 is Euler’s constant. 

T)k! .seinmvanant generating function L,„(t) of the mth cxtieme value from 
above beemnes from (5) and (0) 
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and after expansion 

(7) L„{1) = £ 5 

S W»o, 

whcit' the Bums 

( 8 ) V^2 

k>^m K 

are ul)tained from the siirnH 


(80 





which are known from the theory of the Gamma function. The numerical values 
of the seminvariants of the mth extreme value from ahovcj Xp,m, being the coeffi¬ 
cients of i7>'l ffi the expansion (7) may be calculate<l from a table of the sums 
3,, m given in an earlier paper [3], 

From the generating hinction.s (4) and (7) of the 7nth extreme value from above 
the moment generating function „(?(!) and the seminvariant generating function 
nL{l) of the mth extreme value from below are ol)tain(>d by the symmetric 
relation (2) ns 

(9) .(?(0 = G„(-0: „m « 

and the mean of the mth extreme value from below is 


(6*) “ ^irt '• 

The seminvariants and n\r of the mth extreme value from above and from 
below are linked by 

(10) aJliXm.i. ^ (r — l)tlS,,m *= (—l)’'ammXi- . 

The standard errora <r„ and m<r of the mth extreme values are 

(11) OImffm ~ m ^ (XmmtT. 

This procedure for obtaining the moments of the mth extremes from their 
distribution (2) parallels closely that used by R. A. Fisher and L. C, H. Tippett 
[2] for obtaining the moments of the largest and smallest value. The special 
case m = 1 of the formulae (4), (9), (6), (O'), (11), and (10) leads to the moment 
generating functions, the means, the Hlandard errors, and the higher semin- 
variants of the largest and of the smallest value given by these authors. 

The two parameters and am whiciv exist in the distribution (2) of the mth 
extremes may bo calculated from the observations by virtue of equations (0) and 
(11). Thus, the theoretical distributions (2) may be compared to obseiwations 
even if the initial distribution ip{x) is unknown. For incrctvsing m, the distribu¬ 
tions of the mth extremes were shown [3] to converge toward normal distribu¬ 
tions, their means and standard deviations being given by (6), (6') and 11. 
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3. Generating functions of the mth range and the mth midrange. To obtain 
the characteristics for the mth range and the mth mid-range we state first some 
general properties of the sum and of the difference of two independent variates 
X and y, with means x and y and standard deviations ax and . Let the distri¬ 
butions be <p{x) and ^{y), and let the generating functions of the seminvariants 
Ai, ^ and , be Lx{i) and Ly{t ). We write 

(12) u = i-fy; w = X — y 

from the sura and the difference of the two variates. Then the means v and ® 
and the variances al and al, are 

(13) 5 = £ -f- W = X — y; al = al al = ah 
and the seminvariant generating functions L,(t) and L„(0 are 

(14) Lx(t) = Lxit) -f 4(0; 4(0 = 4(0 + 4(-0. 

The negative sign m the second equation (14) is obtained through the same well- 
known derivation as used for the first equation (14). Therefore, the even semin- 
variants of the sum are equal to the even seminvariants of the difference, whereas 
the odd seminvariants of the sum and of the difference are 

Xv,5r+1 — 4" 4.2»+1 ) Xuj.Jk+I = Xx.Jf+l + (~ 1 )*’’^*Xv.2k+1 • 

If the distributions »5(a:) and ^(j/) are symmetrical one to another in the sense 

(15) '/'(y) = <p{~x) 

then the oven seminvariants of the two variates x and y comcide in size and sign 
and the odd seminvariants coincide in size and differ in sign. Under the condi¬ 
tion (15), the even seminvariants of the sum v and the even seminvariants of the 
difference w are twice the even seminvariants of the variates x or y. The odd 
seminvariants of the sum v are twice the odd seminvariants of the variate x, 
and the odd seminvariants of the difference w vanish. 

We apply these properties to the wth extreme values and write Xm for x and „x 
for y. According to (2) the distribution of the mth extreme from above is sym¬ 
metrical to the distribution of the mth extreme from below in the sense (15). 
The mth range Wm and the mth mid-range Vm are defined by 

(12^) Ufm " 4" 

The mean fCm of the mth range, the mean v„ of the mth mid-range and the 
respective variances al„ and o-^ are, from (6), (6') and (11) 

1 * 9 « 5 2£f2,m 2 

(13') tBm »= 2£„ ; 5m = Or o-v„ = 2a„ = 2m<r = • 

The seminvariant generating functions 4(f, m) of the mth range and 4(fj wi) of 
the mth mid-range obtained from (7) and (9) are 

• 1 “ A P-Siv.m 

Lu,(t, m) = 2 ^ ^ 4,111 = 2L„(t); Lx{t, m) = 2 ^ . 


(14') 



418 


E. J. (iEMIlEE 


The w'minvariantH of the raiine me twice the Keinirivariants of the mth 
extreme values from aliove. Th(‘ even semiiivaria.itsS of tin* /ath uiid-ranRe and 
the even s(>minvaiiants of the 7?ith ranp;e are twice the even seminvariants of 
the mth extremes. The odd seminvanunts of the ?nth mnl-raiij^e vanish. Theie- 
fore, the distrihution of tht* tnlU rmiKe is skew, an<l the, distnliution of tlie lath 
inidrangi' is sj imnefrii'al, From the eonverKenci' of the mth c'xtn'mes toward.s 
normality it follows that the mth raiiRe and tlie mth imd--ianp;e tend also, for 
inereasiiiK indices m, toward nornndity. 

'File seminvariants of the nui|i;e and the mid-uiiiKc ar(‘ oldiuned fiom (KF) 
and tl4') hy [nittinp; m -- 1 and omit I inn Ihe index 1. Therefore, tlie standard 
errors and of tlie ranne and of the mid-ranne are 

(13") ao-u, = —■ '\/2 tr„ = rtff, 

where a. is piven by (1) and (r„ stands for the standard I'rror of the first or the 
last value. The skewness /ii.„ of the ranne and the excess ih 3 for Ihe lanpio and 
tlie niid-ranne 

(It’d lUu. = .lth)28; hi.u, “ 3 =- 1.2 - (j., - 2 

are only one. half of the eori'e,spoiidmn eharaeterislies of Ihe larnesl vahii'. Tlie 
distribution of the lanne is less .skew and le.ss eoneentiated Imvaid the middle 
than the disliilnilioii of the larne.s(. vuhie, 'I’he moments (13) and (Hi) of Ihe 
rutiKe and of the inidraiine may abo he olilaiiied directly I'lom Fi.slier'.s and 
Tippi'lt's re.sulls [21 when indepmidenee of the two extnmies is a-smned. The 
mimei'ical value.s fill) for Hie limilmn distribution of the raiine dilTer eoii.siderahly 
from the, value.s 

(IGO fj.u, - .301); 0--U, ~ 3 - .rid 

given hy Tippett [7] foi a = lOOf) ob.servali(»ns. For increasing n the aiipruaoh 
of lh(' distribution of tlie range toward its limiting distrilmtiuu is very .slow. 
This is ri'usonahle as the apiu'oach of (he distuhutuni of the largest value toward 
tlie limiting dislrilnition is also very .slow. 

Until now we eon.sidered .synimetneal initial dislrihulions The ea.so of an 
a.s^ minelrieal initial dislrihulion may he dealt villi hrielly. I'lie most probable 
mth extreini' value from below diffeis then from — u,,, and 

(!') ,n« = yCnit) 

dilfoi's from a,,,. The distrihution of the mth extreme value fnim below is for 
largo n and small m [3] 

m"' 

(m — 1)1 


(20 


f*tjf(nl*^) wiOl 


t* 
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where 

(3') 


my — m^) 


is a letluccil ??ith (‘\trcinc value from below. The moment generating function 
„G'(0 of the mth oxtreini' value fiom below becomes 


(4') 


„0{() = e""'m 




r(m) 


ami the moment gmu'rating functions G„{t, m) and m) of the mth range and 
of the mth mid-range of an nsyinmotrical distribution obtained from (4), (4') 
and in analogy to (14) are 


(m) 


(IV) 


U'-)jjj^i((i/am)-(i/™«))j, - r -f j r’(m) 

Thus, the moments of the mth range and the mth mid-range may easily be com- 
inited even for an asymmetrieul di.stribution 

4. The distribution of the mth midrange. In the following we return to a 
sYmmelrieal distrihution and establish directly the distribution/(wm) oi the mth 
midniiige. Then, ilu' generating function (14') and the convergence toward 

nomiality will bo veiilied 

From (12') Uie (h.stributioii of the mth midrange is 

/(r'm) = [ dXm ■ 

Intiodiu'iiig (2), the eiiiiation is written 
/(rj - i)pl« ® 


Using as lieforo 


e"’'"' = 2 


the inti'gral becomes 

The distribution of tlic mth midrange is therefore 


^ - 1)1 


mo^Vpi 


,, V _ (2m - 1) 1 fi'"_ 

/(Om) - 


(18) 
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The distribution (18) will be shown to lead to the eeminvariant generating 
function (14'). The generating function of the mth midrange obtained from 
(18) is 

ll e“-’’’''''"-''"‘'">’(l + e"-'")-^ dc^v„ . 

Introducing 

1 + c""'" = u~*; du = -u’e""'" dcx„v„ 


the integral is rewritten 
(2m - 1)1 f' 


(m - 1)1* Jo 






r(2w) 

T*(?n) 


r r - ~) 

\ Km/ \ a^y 


r(2m) 


Consequently, the moment generating function of the mth midrange is 

r (m + r (m - 

\_ ®m/ \ ^m/ 


(19) 


G„(t, m) = 


r*(m) 


This expression is identical with the product of the moment generating functions 
(4) and (9) of the extreme mth values. Therefore, equation (18) is the distribu¬ 
tion, and equation (14') is the seminvariant generating function of the mth 
midrange. 

For m = 1 the distribution (18) of the mid-range becomes the so-called logistic 
distribution which is commonly written 


(180 


/(v) 


ae 


(1 -b e"“0 


Accordingly, (18) may be called the generalized logistic distribution. The proba¬ 
bility F(v) of a value equal to, or less than, v obtained from (18') is 


(20) F{v) = 1/(1 + 0"“'). 

Therefore the distribution/(u) may be exprenacd by the probability F{v) through 

(i8'o m = - fw. 

Formula (20) considered as a growth function plays a r61e in population 
statistics where it was introduced about 100 years ago by Verhulst [8]. Recently, 
it has been widely used by R. Pearl [G]. In his treatment, the value v stands 
for the time, and the function F(v) stands for the relative size of the population 
at time v compared to its alleged asymptotic size. 
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In the following, the influence of m on the distribution (18) is studied. The 
distribution of the reduced mth mid-range 

(21) z = V 

is, from (18) 


( 22 ) 




1 (2m — 1) 1 e’'^ 

Vm ("t - 1)!^ (1 -f ’ 


The probability density of the mean mth reduced mid-range increases with m. 
Indeed, 


<i>m+i{0) _ 2m -f- 1 ^ ^ 

2Vm(m -b 1) 

Therefore, the, standard error of the reduced mth mid-range decreases with 
increasing index m. This is reasonable as the mth mid-range is an estimate of 
the median for the initial distribution. The larger m, the nearer are the mth 
extreme valuc.s to the median, and the better is the estimate. 

To verify tliat the distribution (18) of the mth mid-range tends toward nor¬ 
mality for large indices m equation (22) is rewritten 

If? = lg'i>m(0) + sym - 2mlg^^-~-^ 

ICxpansion of the exponential and the logarithm leads, if we neglect the third 
and higher powers of the deviation z, to 

iB- Is*.(0) + +£-£+■■■) 

whence hy virtue of (11) 

f(u) = Const 


The distribution of the mth mid-range becomes normal for large indices m. 
The mean is zero, and the standard deviation is 


(23) 




V2 



This is in accordance with the statement (130) Si,m tends with increasing m 
toward 1/m. 


6. Summary. For initial symmetrical distributions the seminvariant gen¬ 
erating functions (140 of the mth range and the mth mid-range are obtained 
from the seminvariant generating functions (7) and (9) of the mth extreme 
values from above and from below. As the two mth extreme values are sup¬ 
posed to bo independent our results hold only for very large, sample sizes. The 
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cvi'ii .‘•‘fminvnnants of tin* with nml-iaiiKi' and nf llic with laiiKf romi'ida. The, 
ilistr'diutiiiii of Ihr with laiinc ^kl'w and tlii' di.sfnlmtidii itf the with inid-mnge 
ih thf gcnciidii'.i'd :-yiiinif(ti('!tl lugi-'lif di^tnliutinii Fm- jniTcahing mdicfs m 
till' distriliutiiiu'^ uf ths' with cvlicmcs, tiic witli langc'', luul the wtlh imd-riuigi'S 
cimverge fia\ard iiiiniiality. 
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NOTES 

Thi ’ rniu/ii ?,'■ di'vMi'd to hnej research and exposiiouj articles on methodology 
iitul “Ihi r shill I linns. 


NOTE ON ASYMPTOTIC VALUE OF PROBABILITY DISTRIBUTION OF 
SUM OF RANDOM VARIABLES WHICH ARE GREATER THAN A 
SET OF ARBITRARILY CHOSEN NUMBERS 

By Bhadfohd F Kimkall 

.\i ir Ynrl: Puhlic Hnrice Commission, New York City 

'I'lii- imi'iinsf of note, is to pre-xent the following theorem which the author 
nmlcd in i‘iiiilii‘clioii witli ii ('oinputational problem Since the theorem has 
geiu'i'id imiilii'utinlis for statisiieul theory which do not seem to have been 
broiight out h(‘ii‘lof(irc, readers of this journal may find it of interest 

'rnr.diif.M; In Eneluhan space, of ii dimensions ivith coordinates x, (i = 


2 ' • n) hi a, hi n ninsliLHls whose sum is tio, and consider a hypcrplane 


J'l + .I'a + • • ’ + .Yn — M) 


u > Wd. 


l.a k dnialc a pa.-^iliir rimsiani, and J(?/) the n - 1 fold miecjial defined by 
n ftn) ~~ [ • • f exp. f-z/Z ■ ■ dxn-i 


(2) 

IM - / 

■■/ 

exp. -/.(E 

_ \l*»l 

lah n or/ r 

lli/ll part of till 

' hyper, 

plane for u'lireh 

(3) 


lim \ 

U-^»3 


I’udOt': 

'Phe integral 

may 1 

to reduced to ii 

quadratic 

form 





Ea; 

-zy. + h 


to a Slim of .Miuaies if, such that y. does not involve r>r j ^ Diopping the 
suner.senpt n - 1 in the notation for i and lotting the .sub.scnpt on 2 d™ote 
tlie least valiii’ of i iin'olved in the, sum, the expmisioii of this form may be written 

2i:-G - 2aZ-U + + 

1 I 1 

The transfonnafiun may he performed progiwsively a.s follows. 


giving 


= V2 J'l - (ft - 2 ^0/ V 2 
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Uning thc‘ remainder of Ihi* tortus involving j-j, ono ran complrto the stjuare 
wnlh lorma not involving Xj, ami thi* value of j/j ih 

m = -n V’3/\/2 - (m - 22 J.I/VG. 

« 

Confiiniing until only terms involving x„ i and u remain, 

y„,i *• Vn/Vn ~ 1 — u/\/n{n — 1). 

The remaining term in u will he found to he u^/n. 

Making the above tranKformatioii, the integral hecomes 

(4) I{u) » f f exp. 1^-it dyi dj/i ■ - • dyn-i. 

In order to fix the limila of integration on y, it will he noted that the projection 
of the critical region of the, hyperplane (1) upon the « — 1 dimen.Mional space in 
the original variablea i, delineates a region in that ti — 1 space hounded by the 
n — 1 hyperplanes 

x, = Oi, i 1, 2 • • • , n ~ 1 

and the hyperplane 

Xl + Xl + Xj + •' • ■4- x„,.i «= u ~ Cn , 

Hence, if (2) is considered a.s an iterated integral with the integration per¬ 
formed in the order of the suhseripte of a\ , th(> inU'rvnl.s of integration are 


Bl 

^ Xi 

<u~a„ 

“ E X; 



< Xs 

< It — a„ ■ 

- fli - 

—V 

Xi 

9 

a. 

< X, 

< n - 22 

Xi ~ (uo 

~ E B.) 


r+l r H 


On-l < X„_l < M — Uo + 0«_l , 

n-^l 

where it is recalled that zl denotes , 

r+l I'iur+l 

Now transforming to y, and using the general transformation equation 
(5) J/r “ Xr Vr + l/Vr — {u — I^xO/V(r + l)r, 1 < r < n — 1 

r hi 

where 22 x, = 0 under definition of summation Hvinlnd noted above, 

n 

Lower limit of yr « (w ” 22 x,)/V(r + l)r + arVf + i/Vr, 

tM 

Upper limit of y^ = (it - 22 x,-) \/r/-\/r + 1 - (»o - 22 at) Vr + l/Vr", 

fi I f+l 

since 

Vr + i/Vx — l/\/(r + l)r == ■\/r l \/r ^ 1. 
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It is not difficult to show that 

£ a:< = Cr+iiyi) + (r — 1 — r)u/n 

whcr^? Cr4i(?/i) denotes s. linear combination of yi for i ^ r "f* 1, which does not 
involve the variable u, In other words 

w - E a:. - (r + l)u/n - tlr+iCi/i). 

r+1 

Making this substitution, the limits on yr are found to be 
Ixiwer limit of 2/r == — (■u/n) (V?' + l/Vr) 

+ (^r+iiyi)/\/ (r + l)r + ctry/r + l/\/r > 
Upper limit of y, = (u/n)(Vr{r + 1) - C'.+iCy,) v7/\/m 

— (uo — E ai')\/r + lly/r. 

r+1 

It will now be clear that as u becomes infinite, the limit of the integral in (4), 
will be the n — I fold integral taken over the whole of n — 1 space. This latter 
integral is easily evaluated to give and the theorem follows. 

The following two corollaries, which are restatements of the theorem in less 
general form, bring out the implications for statistical theory. 

CoROLLAiiY 1. With k — 1/2 define F„iu) by 

( 6 ) FM = ( 2 t )-’‘' 7 ( w ). 

The dijiferenlial Fniu)du repreaenla then the probability that n random varidblea Xi 
taken from a normally distributed population with zero mean and unit standard 
deinalion, fall into a region 

(7) o< < aii 

and hose a sum mlh value in the neighborhood (±^ du) of u. 

Recalling that uo is the value of u when each X{ has value a, 

(8) P[ai < iE<] = f Fn{u) du 

•'“0 

is the probability that all values of x fall into the region (7). Denoting the normal 
probability function by corollary 1 implies that 

(9) lim \/nFn{u)/<f>{u/\/n) = 1. 

Since ^{u/y/n)du/y/n represents the probability distribution of the sum of 
the n random variables when the condition (7) is removed, certain, implications 
for the theory of statistics emerge. One of these is noted in the example given 
below. Corollary 1 can be stated in a different form as follows: 

Corollary 2. If pA{u)du denotes the probability that the sum of n random varia- 
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i2r, 


hln Jum a nmimilhj i!i, vuliuiij ptifihlrttuni li> tu ih‘ ut tglihitilwn'l i *. J rhi} af u, and 
Pitiiil rlrntil»-f! lh> priihidnhhf lint On .'^uvt «/ n rnudrm rninshh ‘ inmi Ike .vmie 
pfijmhtuiii llnil tlnfiH ut ni/un, (?) Inii/ n uiiur ui Ihi i w< tifl-l’m loiml Ilf 11, i( fnlhm's 
fuitn mnl lln' unhin nj lln fuurluiu-t utti'jrnli d llnil fnr nihihdi ihj f-mitll ixmlivv, 
5, a rn/)/(’ uj u, vjv »' ran i<> urind, 'difftru tithj hit pi ,; urh ihnl fm all u -* )/', 

(1(1) t\ - hi •* r\it, j'.j < p,lni. 

Hail Ilf riDniunnrt. 'lh»‘ imlliur liavinn 1im>1 iii'i-u-inii )u i‘ri!iijin|i> FJn) ff»r 

Ilf n fiiiiii 2 ht Tt, n, - H, :s fnMf slmwiiig llic lafr of I'lmviMfJicm'c tif 
Fnliii to il> limit for tlii^- lanKC’ of » (atul u, fU h '•liowu lirlow. In tins tahlc 
t!i(‘ value*' of (lie uitioH of fiie iiiiiiiiiiiiiii values of u * • k'I to tile •'(aiiiliinl ilevi- 
Htioii of !/ \/nl tin* slioWM for a ''e([iii‘nei* of vtilnes of 5 wliieli jiiiprotieht's 
zero. 

KnU Ilf ('fiurnI/I ni'i ii/\/)i*'of a\/)i I /o VntF/ fur a, - (t 




f'rtliiitt IliUni 

a' \‘ u 



li «a 2 

n ^ !t 

U ’ 1 

n ■=> .'i 

.5 

(1.(17 

i.;h 

1.02 

2 *1(1 

,25 

1.15 

1.05 

2.05 

H.27 

A 

LIU 

2.110 

li. 11) 

■1.11 

.05 

l.fUi 

:{.02 

11, .SO 

1 05 

.(It 

2.5K 

;ls5 

d.iST 

5.70 

.(H)l 

d. 20 

*1.81 

(1.1 Hi 

7.(I.S 


ICxamplr, An exutniile sliouiiii' the iiotMlile lieaniiM: of tliis flieon'in upon 
pnu'tif'jil niiisiili'nitiotiH of sHuipling is the following: If in n ipmlity coni nil 
proldcni, MUnples of size *1 were used, and a follti\v*ii)) of -tooplcs winch sliowcd a 
lai-RC deviation of sample nictm were pursued, a case cf a pailicularly lacRc devi¬ 
ation such as *1 would jiossildy receive special tUtenlion. With suniiie mean 
ciiual to the ratio of this mean to its stiindard deviation i-^ n 2. 'J'urniiiR 
to the tahle, in column n ~ *1 it will he noti*d that the value of 5 for >/', 2 = *1 is 
somewhat less than .05. Hence from (0) and f 1(1), for n > n' (n' ■ <S, n ~ 1), 

.Of) <ji(u/^/n)/\/n < Fnin) < <t){n:y/n)/\ n. 

It follows that 

n #Ao 

0(a/\/n) du/V a < / F„{h) du < 

I j„i 

If one now consid(‘rs a .set of random samples of size -I, the lust, lUleRnd on (lie. 
riRht represents the expected proportion of tlie set which falls into the suh-set A 
for which u > u' (tind hence with deviation of mean relative to standard devi¬ 
ation of mean greater than a'/v ah ’^1'1'c middle iutvRral represiaits the expected 
proportion of the original .set which falls into a suh-set B for which u > u' and 
X{ > 0. It follows from the inenuality on the left that tlii' expected proportion 
of the sub-set H which falls into the sub-set B is greater than 1)5 per cent Ilencc 



/ <l){u/\/n) dti/\/n- 

J u • 
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one infers that the probability is greater than 95 that for a sample showing such 
a large deviation from the mean (^/y/n = 4, n = 4) all the constituent elements 
will have deviations on the same aide of the population mean. Thus if all the 
element.^ of the .samjrle invc.stigated are found to have deviations on the same 
.side of the pfipulation mean, this could not be construed as additional evidence 
that the sample indicated an abnormal condition. 

This coiic.lusinn is weaker than the facts of the example warrant, since it is 
ba.sed upon the, integral of Fn(u) from id to infinity. Unfortunately the author 
does not have data available on the rate of convergence of these integrals, 


NOTE ON A MATRIC THEOREM OF A. T. CRAIG 

By Harold Hotelling 
Columbia University 

An oxtrernelv elegant theorem given recently by A. T. Craig' and applied 
by him to e.stabli.sh a further theoiem on independent distributions may be 
.slated as follows: 

If A and li are the symmetric matrices of two homogeneous quadratic forms in n 
variates which are normally and independently distributed with zero means and unit 
variances, a necessary and sufficient condition for the independence in probability 
of these two forms is that AB — 0 . 

Tlio proof given that the condition is sufficient is adequate, but Craig's 
trcatiiK'iit of its necessity consists essentially in its assertion In view of the 
growing interest in such (quadratic forms, for example m connection with serial 
corrclalioii, the ueatricss of this theorem is likely to lead to a wide usefulness. 
It therefore .si'cms worth while to give a complete proof of the necessity condition. 

The form with matrix A is denoted by Qi and that with matrix B by Qi. 
Tiie characteristic functions, if defined as and are respectively the 

reciprocals of the .sfpiaro roots of the determinants of the matrices 1 — XA and 
1 — IJ.B, while the characteristic function for Qi and Qi together, 
is the reciprocal of the scpiare root of the determinant of 1 — XA — fjS A 
nccessaiy and .sufficient condition for independence is therefore that 

I 1 - XA 1 • I 1 - I = 1 1 - XA - 1 

.shall hold identically for all valuc.s of X and y. Since the determinant of the 
product of two matrices is the product of their determinants, the left member is 
the hanu! a.s 

1 1 - XA - gB + XmAB I . 

From I Ills il is immediately obvious that AB = 0 implies the independence of 
the two forms. The coiivei.so will now be proved 

' “Note nn the iadepcndonce ot ccitain quadratic forms,” Annals of Math Slal , \ ol 14 
(1913), pp. 195-197 
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We »fliaU aswme Ihert'forc that Q* and Qt arp indpfM’ndent, so that the identity 
hotdb, and prove that AB « 0. 

It mutfc not be auppcwetl lhal Qi and Qi can by the mme linear transformation 
be reduced to forma in which product terms arc absent and only terms in the 
•quRTM of the variatfs api»par. Thn available theorems* leading lo this canonical 
form require that at least one, of the queulratic forms be non-singular. But it is 
of the wenw of the present situation tliat both Qi and Qs be singular, since this is 
implied by AB » 0. It does not appear possible, for example, to reduce to this 
canonical form the pair *{ + xl and x! + SriXj. 

Neverlhcleas a real orthogonal transformation can be found reducing Qi to 

dix? -i- ' ‘ • + d,Xr, 

W’here. r is the rank of Qi. Thus there exists an orthogonal P such that A — 
PLP * and B « PMP~ \ where L and Jif, when partitioned so as to separate the 
rows and columns into successive groups of r and n — r, are of the forms 



Here J) stands for an r-rowed diagonal matrix having dj • • > dr in ila diagonal, 
0 for various matrices whose elements are all zero, and E, C and P for arbitrary 
matrices of appropriate dimensions. Then 

I 1 - U 1 « 1 P(1 - XL)?-' 1 - I ? I • 1 1 - XL 1 . 1 I « I 1 - XL 1 , 
and in the same way, 

1 1 ■— gB j “ 1 1 — gAf I 
and 


1 1 - XA - gB i == I 1 - XL - mM 1 . 

We tlrus have 


U - XL 1 • 1 1 -- gilf I E I 1 - XL - gilf 1. 

From this identity it follows that a pair of forms Q* and Q? , quadratic in a set of 
variates normally and independently distributed with zero means and unit 
variances, and having matrices L and M respectively, are inde-pendent. 

Since AB = PLMP~^, the theorem will bo proved if we can show tliat LM = 0, 
Let 


Ml 


JcTo J ’ 


Afj “ 


'0 O" 
-0 ’ 


so that M = Afi -f- Afi. Since obviously LMt =» 0, w'c need only to show that 
LMi = 0. 


• E g., Bfioher, Inlroduciion lo Higher Algebra, pp. 169, 305. 
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Qj = Q' + Q", where Q' and Q'* are quadratic forms in the particular 
normally distributed variates considered, and have matrices Mi and Mt respec¬ 
tively, Since Q" obviously does not involve any of the variates occurring in 
Qi and since all the variates are independent it follows that Q* is independent of 
Q". Since it has been shown above that Q* is also independent of Q* , it must be 
independent of the difference Q? - Q" == Q'. Therefore 

I 1 - XL I ■ I 1 - mMi I s (1 - I . 

We have: 


ll - XLj =n(l - \di). 

i-1 

Also, 


1 — XL — /iMi 



fiE 



Consequently equating the terms of'highest degree in X on the two sides of the 
identity 


n(l - Xd,) 1 1 - I = 1 1 - XL - uMi 1 
yields the identity in n, 


1 1 - mMi I s 1, 

or upon putting fi = l/x, 

\Mi- x\ = i-xT. 

Hence all the latent roots of the real symmetric matrix Mi are zero. Now for 
a symmetric matrix the sum of the squares of the latent roots equals the sum 
of the squares of the elements, since both equal the trace of the square of the 
matrix. Therefore Mi = 0, Consequently LMi = 0 and the theorem is 
cstalihshcd. 

Since Mi = 0, the following further result is obvious: 

Two ind&pmdeni quadratic forms in a set of variates normally and independently 
distributed with zero means and a common variance can by a transformation be 
reduced to two forms having no variate in common. 

But one of the disjunct sets of variates an the forms as thus reduced is not 
necessarily independent of the other set. For example, if a:i, Xi, *3, xi are 
normally distributed with equal variances and any fixed non-vanishing correla¬ 
tion, the same in each of the six pairs, the sets (xj, X 2 ) and (xs, Xi) are not inde¬ 
pendent of each other, but the forms (xi -f- xz)^ and (xs — are, since xi -t- 
is uncorrclated with xs — . 

I am indebted to Professor E R, Lorch in connection with the preparation 
of the present note. 
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A NOTE ON THE BEHRENS-FISHER PROBLEM 
By llt.NHY Sr-JIhFrf. 

I 'n i> t rdly 

A ftiiiiiiunily iK't'iirriiiK imtUlctu nf infcivtiCP i.s tlu‘ intinpiu-isDU of 

Ihc tncutiH c/f twi) iioniiul iinivci^ii'ti wlu-n fhc lati'i iif flii'ir viiriiUK’ps is mikniiwn, 
I*j'l (jTi, • ■ ■ , ht* a lanilmn Nimpli' from ono normal popultUinii witli mean u 
and V£iriatu’i‘ ju, and (yi , ■ • • , a niiulum wun]ili‘ from aiurthcr witli moan 
find variaiuv v. Tlu* pmhlrm ia flirn that of mukinn; atali.Htical infaroucea 
aliout thn diffraa'iirn 5 fd flu* means, § n (i, when the ratio n/v is miknown. 
(’onvenient testa and eonfidenee intervals are availalile if one ran find a linear 
form L and a (pmdralie form Q in the vertor (Ji , • • • , J"™ , !/i, ■ • , i/n) with 
eftelfieientH iiutefHmdent of the unknown parameters «, ,i, n, i>, such that for .some 
pt£sitive integer k, the qnotient 

(1) (L - di/(Q/k)' 

has the <*ili,slrih\itiou with k degiees of freiHlom, For tliis it is sunirient that the 
following rtiiidilions he s-itisfietl for alt vahies of the pai'umefer.i: it) L ntid Q are 
iniltiii'iidniibi flixlrthulrd, (ft)* K{L\ ~ 5, (I'li) Q, ir'* /ots /kr \^~di.-/it//itlii»i with k 
dt'ijnws nffnrdttm, whi rr iit lltc lurianrr of L. 

In a reeent jiapi'i' 11) the author investigated the Hehiens-Fi'lier iirohlem as de¬ 
limited hy theuhovr three eondifions,** and ainong other results arrived at a simple 
solution. This .solution however iIih-h not have the pioperly that the nuulietit 

(1) is symmrtrie, wherehy in this note we shall mean the following; funelion 
of the sample,s and paraimders w'ill he railed .symmetrie if it is invariant under 
permutations of tin' j's among themselves and of the y'.s among them,selves. 
Isit ns therefore formulate eondition (iV); the qiinlinil (1) ih Hijmmilnr. .Siuee, 
{iv) would he extremely di’.sirahle, hoth for praetieal anil theoretical reason.s, 
and since the author has leoeivial several imiuiries on this matter, it is considered 
worth while to outline a proof that eondifinn.s (n') and (iii) umily tliat (tv) cannot 
he satisfied, in other words, there exists iio “symmi'trie snhitiou’' of tlu‘ Behrens- 
Fi.slior problem within the framework we have imjiosed. Pm'haps this i.s a 
.simple example of a larger eluss of prolilenus m which an npproueh, natural in the 
light of pu.st developments, forces u.s to an asymmelrie sulutioii. 

Suppose (in) is .satisfied. By suhslitiitiiig .special values for the vector (ji, 

• ■ • I -I'm , !/i, • ■ • , l/n) niid then making iiermutatiuiis allowed liy (in) we find 
that L and (J must he of the form 

( 2 ) L ci'Z, X, CtT. Vs . 

» ; 

(3) Q = Cj 2 I? + (14 KiX,- -F CIS 2/? + fa 2 ViVi' + H ■<:. l/j s 

i l/l' ; tfii' 1,1 

‘ E(f) clt'iuilcs lliR exported value of/. 

* Although theae coiulUiims appear simpler than tho-se in [1] they may he sliown equiva¬ 
lent. 
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wheift all c’s arc independent of parameters, and the range of indices i, i' is 
from 1 to m, the lange of j, from 1 to n 
Condition (ti) requires that 

(4) E{L) = a- ^ 

But from (2), 

( 5 ) E{Ij) = cima + c 2 ? i / 3 . 

Since (4) and (5) must be satisfied identically in a, /3, it follows that ci = 1/m, 
Ci = — 1/n, and thus the variance of L is 

(0) = n/m + v/n 

Because of condition {iii) we must have E{Q/cr^) = k, and combining this with 
(G), we have 

(7) E{Q) = kin/m + v/n). 

However, from (3), 

(8) B(Q) = Camf/i + a) + C4(m^ — m)a + Ciuiv + 

+ c^in^ — n)/3^ + c^mna^. 

I'lquatiug (7) and (8) gives us an identity m a, (3, fi, v from which we can determine 
the r's, arul after putting these liack in (3) we find that the result may be written 

(9) Q = ~m) + Sy/{n^ - n)], 

where 

Sx = (a-’t — x)'^, X = '^ Xi/m, 

t i 

Ey = 2 (i/j - yf. y =11 yjn. 

1 J 

The last step of the proof consists of showing that Q defined by (9) violates 
(lu). Write Ui = Sx/n, ni = Sy/v Then Uj and have independent x^- 
distributions. Now (9) states that u = Q/^ is of the form u = aiUi + 02112 , 
whcic Oi and 02 aie constants Let</)(0, </>2(0 be the respective characteristic 

functions of ri, Ui, iq Then 4>{i) = <j>i{ait)<i) 2 {ait) because Ui and «2 are statisti¬ 
cally independent Since the characteristic function of a x^-variable with r 
degrees of freedom is (1 — it is evident that u has a x^-distribution if and 

only if (h rt 2 = 1. hd'orn (9), 

tti/oa = [/x/(m* - m)]/[v/{n - n)], 

and thus a ncci'ssaiy condition (it is also sufficient) foi Q/o-” to have a x^-dis- 
tiiliuLion is 


(10) 


n/v = (.m/ — m)/in^ — n). 



m 


T. N. B. OIR«VIU.t; 


But (m) states that iQ/sr® has a x*-<H8tril)Utioni for all parameter values. This 
contradictioti completes the proof. 

We remark in closing tlmt we have at hand a counter example of practical 
interest to the statement found in several statistica texts that if z is a normal 
variable with wro mean and r is an independent unbifwed quadratic estimate of 
the variance of z, then z/e* has a <-diatrihution. Tlie counter example consists of 
taking z »a f — Ji — g and u «® Q/k defined by (9). It itiay be, shown that z/i>* 
does not have a t-distribution except in the trivial case (10). 

RKFKHENCK 

[11 H. ScHKprfi, Ansfl/s of Malh. Utat., Vol. 16 (ltM3), pp, 35-44. 


ON MULTIPLE MATCHING WITH ONE VARIABLE DECK 

T. N. E. Greviiae 
Bureau of the Cemus 

The problem of card matching haa been considered by a number of writers. 
A complete bibliography has been given by Baltin {!], who also publisherl the 
moat general treatment of the subject to date, dealing with tluj simultaneous 
matching of any number of decks of arbitrary composition. He. considers, 
however, only the case in which the order of every deck is varial)h‘, all possible 
permutations being equally likely. Some interest attaches to the case in which 
all the decks but one have fixed orders in relation to one. another, espeeially in 
connection with radio experimente in telepathy, whore a large immber of subjects 
simultaneously attempt to call the same target. 

The simplest cose is that in which the target for eacli trial is chosen at random, 
independently of the other trials. If the target is to be. selected from s possi¬ 
bilities, and if Pf denotes the probability that the tth poasibility will be chosen 
as the target, while to< denotes the numlsjr of subjects who call the tth possibility, 
then the mean value of h, the number of correct calls is, of course, 

■ _ 

(1) = K PiTUi , 

<_! 

and the variance is 

<2) B"* “ Z Pirn] ~ Ml. 

Evidently, the mean number of hits for a succession of trials is the sunr of the 
means for the individual trials, and the variance is the sum of the variances. 

A slightly more difficult problem is presented when the target aeries is a true 
“deck": that is, when its composition is determined in advance, only the order 
being left to chance. Let n denote the number of trials and ndi = 1, 2, ■ • > , s) 
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the number of targets of the tth kind so that ^ n,- = n. Also let mt,(j = 1, 2, 

t=i 

• • • , n) denote the number of subjects who call the ith possibihty on the jth 
trial, and let mt denote the total number of such calls in all the n trials, so that 

rt 

m, — 22 ■ Then, using the ingenious type of counting function introduced 

by Wilks [6] and improved by Battin [1], we define 

where N = nl / Tt Wo also define an operator Kn, such that if m = u(xi, 
I i-i 

Xi, ■ • ■ 1 a:,), then is the coefficient of ■ ■ • x?' in u. Then, if h 

denotes the number of hits 

P(h — r) = coefficient of e'‘ in 


Also, 


Eih”) = 7C«. 




B~a 


It follows immediately that 


(3) 


1 *• 

Mk = - nitrii = 'E.p.mt, 
fl i>**1 


where pi is written for n,/n. Similarly, it can be shown that 


E(.h^) = J E («< 22 

n ^-i \ / 


+ 


n{n — 1) 


nAni — 1) E rniimi* 

„fc-i 

)V* 


+ 


n(?i -• 1) , 

>>)' L 


n^ni 22 
k,l~l 
Ml 


n 

If we write X,*, = 2 , it is found that 

k~\ 


(4) Vk = —^ TE - w?) - 22 ViViinhii - • 

It should bo noted that it is not necessary that the total number of subjects be 

the same for each trial. , . . r v 

Certain special chses are of interest. Wlien there is just one subject for eac 
target, as in the ordinary matching of two decks, h/ = wii for i = j, and 0 other¬ 
wise; and S.-nii ~ n. Then, if xi denotes m,/nand /jf = 1 - x., and if g, = 1 - pi, 

(5) Mk = nSipixi and [2.pig<xipi -H Eu 
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a (‘tiiiiiiacl (‘XjiK'j'-inii wliii'h i** in thi’ (Vtiiii-* [nrvimif-ly Riven by 

Steven*- Jt. "il, Clreenvvuuil ‘ 25 , Huttin n!i ntitleir Sitj. 

()ti the nflitT band, if tlx* iliffeteiif kiiidx nf neeiii with ecmul ficfiueney, 

Kn that every p, - 1 e uinl eveiy fj, ^ (x 1 ) atnl if vi, = and v » 

S.nu ~ iijn , the expit, **11111 * It beeiiiiie.*- 

(6) Vh- " , ie*-• 

' ' S‘(ll 1) 

HhFKUi;\‘fl-,S 

(Ij L h. ItATriN, "ttn (lie prtifileiii ef iiiiilli|>le iiiatelniij;," .Ireeih nf Sfriih. Vol 13 

(lOlUj, iil>. ‘-tu »):*. 

(2) J. A. Ciiw eNUdtni. “The fir.**) Inur iiiMnieul« of n Ki’iieml iniileliiiix iirnlilem.'' .'tnaafs if 
KugniicH, V<il, 1(1 JiaiHi. m* "i'ln ’J’.C, 

(rtj T, N, K (iHKvnta., “The freiiueticy dWtritnilinii nf a neiieral inatrlriiij; pmlileni," 
jl wnni'i fi/.I/ h!/) . .''(fjf , Viil rjil’Ml 1 , pp 3.'>1 

t*l] \V. L Kij.vt.xh, “Ilietrilmliiiu of eiiirien iti a eotiliiiKi'iiey table.'’ .liiartit if Euyemcs, 
Vol t> pp 2'!^ 21! 

|B1 \V. 1». STf.Vr.Ns, of Muitiheniiee for eMra eeiiteuj ]H‘r<'e]i(iiiii tlalit,'' Pnychnl. 

Rmnr, Vol. -Ui fllCth *. pp 112 ir-O. 

(fl] H iS, Wn.Kh, “iSlaliHlieal aspccla of e\iH*riiit»iitH in telepulhy," n leelnre tlelivereil to 
the flaloirt Inetiliile of MatlteiiiaiieK. f-oiij' Idlioel 1‘tiivi‘rHily, llet* 1, 10,37, 



BOOK REVIEW 


“Sindcni'ti” (Collected Pdpcis. Edited by E S. Pearson and John Wishart. 

Biometrika Office, London, pp. xiv + 224. 1942. 15 shillings, 

Since the question es still asked from time to time, it may be well to state that 
‘Student’ was the pen name of William Sealy Gosset, After taking his degree 
in mathematics and natural sciences at Oxford, Student worked as a brewer for 
the well-known firm of Messns. Guinness—in Ireland from 1899 till 1935 and 
thereafter in London as head of the new Guinness brewery established there, 
lie died in 1937 at the age of 61 Between 1907 and 1937 he published twenty- 
one papcr.s and a feu' notes; the.se arc issued in the present volume as a tribute 
from a group of hi,s relatives and friends. 

Student’s name i.s almost universally attached to a single discovery, the t-test, 
which requires for a complete proof more powerful niathematical methods than 
he devised. 'I’hc.se facts may cause his papers to be regarded as museum pieces 
by people' who have not read them Actually, in many respects no better model 
than iStiident could be .suggested for a young statistician today. Since we some- 
f,lines speak dori.sivcly of courses of lectures in statistics where the methods and 
ideas aiC' “20 yc'ars out of date”, it is interesting to find that many of the funda¬ 
mental ideas eonsidcred mo.st in need of emphasis by forward-looking teachers 
today were in fact empliasizod by Student in his wiitmg.s over 30 years ago 

For o.xample, his clu.ssieal paper on the i-test, pubhshed in 1908, opens as 
follows; “Any oxporimciit may be regarded as forming an individual of a ‘popu¬ 
lation’ of experiments which might be performed under the same conditions. 
A scriG.s of expcrimciiCs is a sample drawn from this population. 

Now any series of experiments is only of value in so far as it enable.s us to form 
a judgment as to the, statistical constants of the population to which the expeii- 
menis belong”. 

The idea is elaborated in a second paper published in the same year. “Note 
that the inclefinitely large population need not actually exist. In Mr. Hooker’s 
case his sample was 21 years of farming under modern conditions in England, 
anil included all the yeais about which infoi'mation was obtainable. Probably 
it could not actually have been made much larger without loss of homogeneity, 
due to the mixing with farming under conditions not modern, but one can im¬ 
agine the population indefinitely increased and the 21 years to be a sample from 
this.” We note here a further observation, not always appreciated, that in some 
linc.s of research .samples which arc both large and homogeneous do not exist. A 
clear conception of the relation between sample and population is evident in all 
his ivork: one further quotation, the summary from his 1926 paper, Mathematics 
and Agronomy, will suffice. “To sum up, in planning agronomic experiments use 
plenty of replications and make quite sure your results are capable of being con¬ 
sidered to be a random sample of the population about which you wish to draw 
conclusion,s.” 
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Atiotlier notirralilc* fratiire <if Sfuripni’a ivurk in liin (’rmctfrn aUout tlm extent to 
which the iiiathenmtical tnotlel nnflerlyiriK his htatistica! ttThniqnpis really repre- 
«;nta the facta of the data. Further, he in ulway,** ready to give hiti ojunioti, from 
considered thought, tw to whether the dwercjianciw between the model and the 
facta will tifTeot the eonchiaioiis inaterinlly. In his lirat paper, On thr error of 
counting with a harmarglomrirr, he ahowa that the Ihiiason liistrilnition applies to 
the total number of cella or corptiwles which are found in a tliviHion of the hae- 
maeytometpr field. He is rareful, however, to point out three ways in which 
deviations from the PtiLsson law may oeeur in praetice: (i) there may be, inter¬ 
ference between the imrticles, though thi« is ronaidered unlikely in high dilutions 

(ii) there may be clumping tmti (iii) (jirobably the most important, in his view) 
the drojis taken out for counting may not reprewnt the hulk of the litiuid, giving 
liac to an additional sampling error suiwrimposed f»n the Poisson error. In a 
later paper An explanation of deviations from Pomon's Uiw in praelice. {1919), he 
makes a critical examination of the assumptions neceasary for Poisson’s di.stribu- 
tion, and shows the type of distriinition to he expected from the invalidity of one 
or another of the aasumptions. 

Similarly, in the ojicning paragraplm of the, HKIS pnj>er on the t-test, he notes 
that the assumption of nonuality in the parent distribution may not hold in 
practice. Then follows his opinion on the importance, of this assumption: “It 
appears proliable tliat the deviation from nonuality must be very extreme to lead 
to serious error.’’ 

Hia earliest papers deal with ntlcmptw to find aoveral exact small-sample dis¬ 
tributions for which ho and other workers in Britain felt a need. I.»acking the 
mastery of probability theory necessary for obtaining a rigorous solution, he used 
a combination of mathematics, intelligent guesswork and iuferenew from repeated 
samplings which ho drew. For example, the steps in his develoinnent of the 
t-distribution were as follows: 

(i) The distribution of the mean square, s’, being unknown to British statisti¬ 
cians at that time, had first to lie found, Btudent calculated the first four 
moments by algebraic methods, Noticing that the condition for fitting a Pear¬ 
son Type III curve (2 /3j — 3 )3« — 6 =* 0) held exactly, ho inferred correctly that 
8* followed a type III curve. 

(ii) He was aware that the joint distribution of s’ and the sample mean £ was 
necessary for a solution of the problem and further that the form of the joint dis¬ 
tribution depended on the correlation between 2 and s’. Having shown by alge¬ 
bra that s’ is uncorrelatod with either £ or .E’, he assumed (without further com¬ 
ment) that the distributions of £ and s’ were independent. 

(iii) The final stop to the i-distribution was performed rigorously. 

(iv) The result was thou checked against empirical data. He used the heights 
of 3000 criminals, which provided 750 samples of 4. Another set of 750 samples 
was supplied by the lengths of the left middle fingers of the same criminals. 

In 1908 Student also published the distribution of the sample correlation 
coefficient r, in a bivariate normal population in which p is zero. His interest in 
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the problem arose from a meeting of the Royal Statistical Society, in which an 
inquiry was raised about the significance of correlation coefficients derived from 
small mnnbers of cases. The authorities present, Yule, Hooker and Edgeworth, 
ventilled their opinion on a specific instance, but had no general answer. Ac- 
corrlingly, Student set out to find the general distribution of r, without assuming 
p zero. ni,s mathGmatic.s did not take him far; providing the solution only for 
sample.s of 2, whore the frequency is zero except at —1 and +1. In order to 
leain what empirical result,s could teach about the form of the distribution, he 
then drew four sets of 750 samples, the sets having p = 0, n = 4;p = 0, n = 8;p 
== .00, }i = 4, and p — 66, n = 8, respectively. 

Ue considered first the set having p = 0, n = 4. Now, for samples of 4, the exact 
distribution, C{1 — , reduces to a rectangular distribution For his 

purpose, it would seem that Student had been unlucky in his choice of n = 4, 
■Since tliG rectangular distribution appears to furnish little or no clue as to the 
general fonn of distiibution when n differs from 4. Actually, things could not 
have turned out better. Referring, as in the case of the distribution of s^, to 
Pearson’s curves, ho selected a type II on account of the limited range of the dis- 

/ \ 0 272 

tribution of r. The fitted curve was found to be Cf 1 — ) • This sug¬ 


gested to Student that the true form ought to be C(1 —giving a rectangular 
distribution, the general form was guessed as (7(1 — The samples of 8 

were then used merely as corroborative material. One wonders how Student 
would have fared, both in this case and in the case of if the Pearson system of 
curves had not been familiar to him. The method did not of course provide the 
much more complex distribution when p is not zero; however, Student was able 
to write down several important properties of the distribution for the guidance 
of mathematical statisticians who might be interested in the problem. 

By similar methods he attempted (1921) to find the frequency distribution and 
the efficiency of Spearman’s rank correlation coefficient. Much later (1936), he 
remarked in connection with this coefficient that, though it was not fully effi¬ 
cient, “it was so simple that when playing with other people’s figures, for instance 
on a railway journey, it was the obvious one to use ” 

Ills paper. The cUrmnaiion of s-punous correlation due to position m time and 
space, though biief and incomplete in its treatment of the problem, established 
him as one of the pioneers m the use of the variate-difference method. His sug¬ 
gestion was to correlate the nth differences of x with those of y forn = 1,2, • • • 
until a point was reached where the correlation ceased to change. This lunitmg 
correlation would be free from spurious effects due to trend factors. Such 
methods, ho remarks, help to show “whether there really ^s a close connexion 
between the female cancer death rate and the quantity of imported apples con¬ 
sumed per head.” 

III.? association iiith field experiments conducted in Ireland for the purpose of 
devclojiing high yielding varieties of barley suitable for brewing led to an interest 
in the design of experiments, to which he devoted seven papers. His philosophy 
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cm llii'- '•niijcci. fSiHJifih {r, ui* oiif nf lutinniiv with the* 

j»hi!nMi|(hv tsiuiiilym^ I'Vhm . v.;i~ ,j imuii;*! ntiimnwlh of Stiiilcut s 

gt'iifUil altiiMih* luwiuti- sit* icjiithv‘M mk- ii‘•i.jM'-’v.tl Ht* ln'lii'xi'd 

thus, frniu udifini <> n! moI li-ilihu jihi- l.um'.li il^c nf iIk* 

luMdl) (tplff Jii<M Hi Iijin I itiiM rnii^li'iict ^ 

PVfiN'liiatic’ (IfHCli whii'h I'.nnld hi Mif Jti|iMij)iij||(. 

raiiiiiiiiii/.i’i!‘li'^igii St't'niiiiiv. altlifi'ich (li’iijii' I'!'* iiii ii[iiiiir>, a.''it 

\\(w, tnsipiily ilii- laiidMiii ('lmi)i'H? i:»m-'M n fii! ilii* ajijthiatinii nf iivnl.aliihty 
thclily. Ii(‘ lirltiWi'il, again finiu kim'.tli iigr n[ l•lm(lll(ll|| >, il(„f Ihn dhi'ii'pan- 
c'ii'*' tlii‘ ui;itlii'iii,iii''.il iiiitth! aifi till- fmn iniMinv |t,'iiiniii udiilil not, 

RC*nrm<'ly Mini!** tin* (“ 4 iiii!i!i' <<1 (ami lln \ i.ii hr nmiM liavn cairird tlu' aiivo- 
(wy tif'‘V'ti'iiiuliraiiaiigniii'ii!- 1 “lint ('l<Mi .(i! n! im ■iM'ibdim-- ii'IVr 

to an'inigi-iui'iil" i'n i‘i>iti]i,iii!ig nuly i»*!n Mniimi !. hi* '-tln-i'il w- 

jiculcilly lhi‘ 111 iT-MlY I'ti railying n«i} siic!i 111 ih n'.i r '‘-.i 1,(1 M-a'-iiii' ami at a 
ciiUMdi‘iult!i‘ iiiiiiiliiM "1 pl.iri’*', 111 niiii‘1 t»t ',iiiij(!i' , « 'Jii' i'ami fiiil vaiialiiiiiH, 
111 ‘'Ill'll ('a‘>i“'lhr“ ‘'latj'h'Ml ‘igllilMMlIi r nl a lr'l!|l ;j) a pi H'i*i|i(| Mill iMll'if'.f 

Stii'li'iil gii'.'tlly. 

A ln\ nMnlallnlh nl 111- nplllInti'nil Iiiii)i*i|ri.ilii'ii 'jil*'-'( m,)' iIIm- tl.il i‘ 111'-MIhIiM'- 
fltamliiig Ilf tin* alliimli' ni tin* hmm't ami ascmmimj ! iml la- ilimri Mimli* nl' 
e,Slii(^>iim Spcitkiiig nt inpiMiuii'M’I'lnn aiiii l.ng> plni-., he -a\, "ii hav tho 
ailvuiitiige thal the Inline!', nlni aiwa\'h.i*-a heallln ennh iiipl ini giiuleiiing, 
may pav Mime all"riiiiiii in the m -nl!. " (in ailpmlim iih tn \ lehl data In allinv 
for vaiialinim in muI leilihi). he muIi". ‘ I'iiem s- > gm it «h 'idvaiilage 111 eor” 
reeling any ligiiiiM for pn'-ilinn. iiiaMinieh a n a\ni'' ni ennLiiig. and lie'ides ihe 
correeleil ligiii'e-. iln iml reprer-eiil anything mal " l.nng e\pi'Ut'iiee had made 
him more and ninri* eniuiiieed ihai a Mnial euiielatinn i iiieulahie in rnulhu' 
cheniieal anniy.'-e!': aeenrdingly, he itdviM's; "'riie ehemmi wlin wi'-hes In impress 
his elients will therefnie aruume In iln vepetilnni aniil.VM'^ a"- nearly us ])n'Ml)le lit 
thoHiuue time, hut if he wishes to tlimiiiidi hm realmrror hi* will "epainte them hy 
as wide an interval of time as pn''‘'ihle.'' 

Re-reiuling of Stiidenl’K pitfiem has lieeii a kei'ti pleuMire, It. is hoped that ihe 
vohime will enjoy ti wide eireulalion !tm(iiiK''t stafi'.iieiatis. 


W. (1. CofUtUN 




